Background Dat a ^ ' 5 

An examination of the student demographic information collected in the 
fall (see^ Apjj^ndix A> shows the -true experimental group to be very similar ' 
to th^ true control group. This wo"ld be expected because of random 
assignment, V ^ » 

Summarized in Table 1 are tenth grade School and College Agjuevement Test 
(SCAT) scores and cumulative Grade Point 'Averaye (CPA) for all groups ^ 
except the CWE students. For comparison purposes, data from a random 
sample of Tigard High School students (FV 74 THS Random Sample) and from the 
FY 74 (CE)2 PQpulation have been included in Tabl^l. 

Table 1 ^ 

^ TENTH GRADE SCAT SCORES AND GPA OF 
(CE)2 AND CQMPARI^^-^N GROUPS 



^ . ^ Score 


4 


Group 


Exp. 


Ret. 
Srs. 


Pre. 

'SelV 


(CE)2 
All, 


FY 75 
THS 
ICon. 


FY 74 
THS 
Ran. 
Sam. 


FY 74 
(CE)9 




*x 


1 

48.8 


43.7 


59.3 


49.1 


48.6 


51.3 


45,9 


SCAT^ Verbal 


s 


8.4 


10.4 




10>2 


8.9 


8.6 


9,1 




n 


29 


17, 


10 


56 


21 


63 


34 




X 


44.8 


42.7 


62.8 


47.4 


45.2 


51.3 


44.7 


"^SCAT Quantitative 


s 


7.5 


8.9" 


6.8 


10? t 


10.0 


9.8 


8.6 




n 


29 


17 


' 10 


56 


21 


63 


34 






















X 


46.6 


43.2 


62.4 


48.4 


47.0 


51.4 


44.8 


SCAT Total 


s 


7.4 


9.5 


6.2 


10.3 


9.2 


9.0 


8.4 




n 


29 


17 




56 


21 


€3 


34 


• 

GPA 


• 

X 

s 

n 


2.42 
.50 

31 


2.19 
.62 
9 


3.27 
.39 

12 


2.58 
.63 

52 


2.42 
.54 

21 


2*'81 
.72 

70 


2,11 
.65 
38 



* X group means; S = standard deviation; n = number of students per cell. 



These scores generally ars consistent* with (CE)2 staff judgments about 
subgroups of students within the (CE)2 population, the returning seniors 
as a group Exhibited the lowest^retest achievement scores and the ' 
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ABSTRACT 

Evaluation conducted during the 1974-75 school year 
of the rxperiende-Based Career Education (EBCE) program at Northwest 
Regional Educational Laborettory (NRBEL) is reported,- focusing on the 
evaluation findings of the EBCE demcn:^tration project in Tigard, 
Oregon called Community Experiences for Career Education (CE)2, and 
various EBCE implementation .activities in other districts. (EBCE is a 
comprehensive, individualized career education program that 
integrates basic skills, life skills, and career development through 
work -and learning experiences in the community.) This Bfeport contains 
results derived from a comparison of (CE) 2 experintental group 
students with control group student*, results pertaining to all (CE) 2 
students, findings from seven student case studies, and program 
evaluation findings. Summary of evaluation data collected on the 
implementation activities at NWREL includes an external evaluation of- 
Project TOTAL (Total Opport unit ies . through Action Learning) , an EBCE 
program based on (CE) 2, reactions aijd perceptions of sites which used 
selected EBCE materials, an evaluation of implementation training 
workshops, and evaluation data on the overall implementation 
strategaTes and planning. Additional descriptive and technical data 
are contained in a separate volume cf appendixes. (TA) 
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CHAPTER I. ' EXECUTIVE SUMMARY , . ^ 

Introduction ^ s " ^ , ^ 

This report describes the evaluation conducted during the 1974-75 school 
year by^the evaluation unit of the Experience-Based Career Education ' (^EBCfi) 
program at Northwest Regional Educational Laboratory '(NWREL). EBCE a* 
comprehensive, individualized career education program that^ integrates .a 
high sch(x>l students* learning of B^sic Skills, Life Skills and Career 
Development through work and learning experiences in* the community. This 
report focuses on the findings from ^the eimluation of the EBCE demonstratior 
project in Tigard, Oregon calledf Comm\Inity Experiences for Career Education 
(eE)2f and various EBCE implementation activities' in other districts 
during the' 1974-75 school year. ^ 

9 " -. 

Audiences ' 

Audiences for/whom this report is ihtenJed include: "the National Institute 
of Education, sponsor of EBCE re:Search and developments educators who may 
be considering the adoption of EBCE in their districts? personnel 
associated with (CE)2 and 4:he pilot** sites from whom data wete collected; 
educational researchers; and persons interested in career education and * 
alternative educational programs. - ^ 

Report Format 

Persons with limited reading time are duvised to begin with Chapter V of 
this report for a summary and discussion of all findings written in 
nontechnical language. In Chapter III -(CE)2 evaluation findings are 
featured in two ways: ^'(a) results orgemized around each of %he (CE)2 
goals and (b) xesults from each evaluation instrument. The first 
structure will probcibly be of greatest interest to educational practitioners 
while the latt^er sti;ucture is intended 'primarily for a research audience. 
Persons interested in understanding how in^^vidual students fxipction in 
EBCE and how the program affects them will find the case Studies of (CE)2 
students in. Chapter III helpfux. -The brief conCli>bions and recommendattions 
dhapter is intended for educational practitionels, researtiiers and the lay 
reader alike. Additional descriptive and technical data are contained in 
the separately bound volume of appendices. ^ 

Hi ghlights of (CE)^ Comparative Finainqs 

The 1974-75 school year marked the third year of operation for (CE)2r which 
is operated in Tigard, Oregon by a nonprofit community corporation asr NWREL' s 
"parent .site'*' for research and demonstration of EBCE. (CE)^ enroiletl 
approximate-./ 60 high school juniors and seniors f rom -Tigard High ScSool"^ 
and hais ^professional staff of 7 members. Ov :r 120 employers and* 
comr-mity people cooperated with (CE)2 in providing learning experience's, 
for students in the conmCmity. ' 

From the list of applicants to the program, students were randomly 
assigned to (CE)2 or to remain at the high school as a control group. 



It) 



This •'section of the'Executive Summary reports the comparative findings of' 
thBofe twt) ^oups, while' the next "^sectiq^ jiertr^lls gains (CE)2 students 
alone. . ' • ^ , * - 

Students. in the fCE)2 program and control group were tested oft a number 
, of evaluation instriin^^nts at the beginning^ ctnd 'end of the school year. 
The^e instruments coyeredythe pirbgram's three curriculum arenas: Basic; 
/SkiHs, Life Skills^nd CareeV DaveJ^pjAnient. It 'was hypothesized that the 
/ (CE)2 experimental students woWld do as well as tht {?ont'i:ol group studenjts 
in terms of gain§ in Ba^c -Skills, while exceeding the Vontrol t roup in 
Life* Skills ai\d Career Development skills. On the CQmpi e >>-"^,^^ve Test 
of Basic Skills °there were no statistically sigh;LficaXt differences in 
the gaifts made between the (CE)2 experimental group .and ^ the v:on'trol group 
at the high school in r^eaddng, arithmetic or study skills. 

.i/uestiC)nnair"»s adminstered .to both -experim^ ntal and control group students 
at the beginn"{iig and end of^ the gc^hool x^ar indica'ted .that (QE) 2? students 
Increased more in the amotint of reading ^done during the year them did the 
control gro''p. These differences were flue mainly to increases in the 
amount "of pamphlets and newspapers. , ^ * , -^^ 

* ' • <" 

Because the Life Skills area of (CE)2 does not have a direct parallel ip 
4:he regular' high school program, only indirect measures of these skills 
were assessed on a compar^itive basis. The (CE)2 students appear to have 
. becdhie less idealistic, in their concept of work and more critical in 
self-assessment of their qwn personal work habits than the cJontrol group^. 
No 'significant differences ^re found between the (CE)2 and control 
group students on self-reporxed, measures of individua. or social adequacy, 
nor on ability to match their career preferences with persgnal ij^itereets 
and abilities. Ovei 80 percent of the students in both groups Indicated 
career preferences congruent with their personal attributes. 

On other areas comparing the performance of (CE)2 and, control group 
students the (CE)2 students scoured significantly highet in: (a) knowledge" 
of information related to the worlji bf ^work, v (J) self-confidence in the 
ability to complete the necessary steps for entering a career of their 
choice, (c)' -use of publi*c resources, especially public libraries, 
(d> number of , public metetings attended and (e) pe2;ceived overall**^ 
effectiveness* of their educational experience 'during, the year. 

No significant differences betwoen the (CE)2 and control group students 
wer^ found i,n: (a) level of career choices; ^ (b) amdHmt of post-secondary 
education planned, (c) proportion of- jobs list^ that %±udents had i;uled 
out as career choices during th^year, (d) sources of information used iti 
decisions to eliminate potential careers and ("of' attitude toward the 
concepts of "me," "school," "adults," "learning," "conjmunity resources" 
femd* "decision making."- 



Highlightybf (CE)^ Student growth Findings 

In addition to comparing-the results o^ {CE)*^ and control group s^dents, 
other data were reported in terms of whether the (CE)^ students made 
statistically significant growth during the year. When viewed from this 




perspective, (CE)2 students made statistically significant growth in: 
(a) readihg comprehension} (b) ^ithm^tic concepts and applications; 

attitudes towards the concepts' of "me," 'community resources," "adults," 
"s^-hool;"* (d) attitudes of trust and-openness tb change; and 
(e)^ "capabi3ity^"tx>rap£ly^ leaned behaviors and to assume responsibility r " 
understanding another peTson '^messages and feelings and "conversation * 
with cm «dult' that reveals self -con ftdenc^ as rated by'^(CE)2' staff. 

In terms of student evaluation of (CE)2 all but one of^Clle^^E)2 students 

indicated in May tjhat they did not regret their decision to :join thV-^prc^ram. 

• ' ' — — . 

When comparing iCE) 2 to the regular high school prograift 96 percent. of the 
(CE)^ students 'Sported that (CE) 2 provided more opportunity to learn 
■ abput^ cfcoupations and 70 percent reported more opportunity for general 
learning. ^ine»-y percent of the (CEjp students reported th^t they were 
more motivated to learn in, *(.tfE)2 than in the regular high school. 

When asked what they perceived to be th^ greatest strengths of the (CE)2 
program, 33 percent of (CE)jj students identified t^ie opportunities for 
"hjands-on" learning, '33 percent identified the ^pathetic^ ^nd helWul 
staff / and the rest mentioned 4 variety of things including the opportune *cy 
to learn about careers and the f reedonv and^ reSponsibi'lity given students. - 

\ , ^ ^ /\ ^ 

The "lost commonly men*"^^ned vyreakness .of the program (mentioned by 15 percent 
^of the studentsV^ jsn vol ved • difficulty or inponvenience in securing a desired 
employer site. Other problems mentioned included transportation arrangements 
(6' percent) and "t6o much work" (6 percent)^ 

A Comparison, of * the number of competencies and projects completed by (CE)2 
students'^is year witb those completed by «<CE)2 students the two p^ior* 
years indicated that stu<Jents completed substantially* more work this year. 

Documentation of weekly-dibcussions by the (CE)2 staff regarding obsjervable 
behaviors in each student revpaled that many students grew significantly 
in assuiiiing responsibility for their actions and in cooperating with 
program staff and employer instructors. Significant growth was noted* also . 
by the staff in students* jjjility to coiranunicate effectively with adult.^ 
and with fellow .s+"udents^ ' ' . 

f . s " 

Intensive case ^tudieg of (CE)2 students illtlstrate^ the anxieties, 
struggles,, frustrations and personal growth of seven young people as they 
progrd«sed through (CE)2. They also i^evealed the 5 variety of ways that ; 
employer instructors and* staff work with these students. Evidence was 
also given to show that workWalues were biaing realized, developed and 
changed* as a result of (€2)2. * 

lYi an attempt to. find a y^read that helps tie together the numerous 
separate findings, and to describe the major impact EBCE has had on students, 
the most important outcome, in the judgment of the evalAiatcjrs, is that ^ 
EBCE has helped*' increase in many students a sense of their personal worth 
and an increase in their self-confidence. This outcome may be more critical 
than any other in helping students to become mature adults. 



EBqE Implementation Activities 

Orientation, training and technical assistance were provided to districts 
j.n the Northweat^ ^t e re s t e d i i impl e ment rng-gB^ — One ttisrtTict^in 

' Killsboro, Oregon selected to begin operating of an EBCE program during 
tlfe 19*/4-7b school year. Four other districts — Billings, Montana; Colville, 
Washington;. Kennewick, Washington; and Kodiak, Alaska chose to use 197t^-75 
as a plaj[\ning year and to begin operation of EBCE during the 1975-76 school 

\ year. Several o*-her districts participated in EBCE planning during 1974-75 
but were unablf* to begin operations during the 1975-76 year because of 
budgeting problems." 

Ii^fonnation on each of the fovu: pilot sites that will begin EBCE J^Rerations 
in 1975 was collected and organized into the following categories: advisory 
boarrd, school staff, number and characteristics of stud^ts, employer 
recruitment, ph^ical facilities, funding, parent involvement, school 
bbard actio^ii^r and EBCE materials received and used. 

Ifi addition to the ^BCE demonstration site operating in Tigard^t second 
EBCE. site began operation this year in Hi llshoro, , Oregon called Total ^ 
C^pdrtunities ,ThrQugh Action Learning (TOIAL) . This program operated 
with up to 30 students from the ninth to twelfth grades and was developed 
to help students whc had not progressed satisfactorily in the regular high 
school 'program. Perhaps the most significant finding regarding TOTAL 
students was in their attendance records. During the year prior to 
entering TOTAL these students had an average school attendance of 36 percent, 
During tl*^ first and second seroesteirs in Project TOTAL, however, these ■ 
students averaged an 86 percent attendance rafte. 

Quest iorihaire results were obtained and analyzed from four 6f five 
school districts in the Pacific Northwest where selected EBCE materials 
were used. The general reaction to these materials was favorable and 
the materials 'were used in an interesting variety of ways. 

Evaluation results of other EBCE inplementation activities are presented as 
answers to 18 questions. As a ?sult of effective EBCE implementation 
planning last year, five schocl istricts in the Northwest will be 
implementiVig EBCE during 1975-76 using local funds. 
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CHAPTER II. ' INTR0DUCI|I0RN^ 
Section A « Purposes and Coatent of'^the 



This FY 75 final evaluation report has been prepared an compliance with 
reportirg requirements of the Education and Wcrk staff of the National 
Institute of Education (NIE) . As a year-end report, it is intended to 
serve four audiences. First, the EBCE operations staffs may use.. portions 
of this report as feedback to continually improve their programs and to ' 
answer questions visitors might pose. Second, the NWREL BBCE in^^lementation 
staff and practitioners considering the' adoption of an EBCE prograun ma^ 
use this information iiLjjiaking decisions aboMt iihp lamenting the EBCE 
program in other settings. Third, school district personnel in districts . 
where EBCE is now operational' may use the evaluation report to become more 
aware of the program's effects. And finally, NIE, the U.S. Office of 
Education a -* the researqh and^jgeneral education audience may use the 
report to help them examine the prgram's effectiveness in terms of action 
research. , * ^ 

The report is organized into six chapters plus a separate volume of 
appendices.* Chapter I — "Executive Summary" — is a four paige synopsis of 
the FY 75 evaluation findings. Chapter II — "Introduction" — contains a 
summary of the purposes and contents of th£s report, a description of 
EBCE and {CE)2, and ^ summarry of evaluation activities in FY 75. 
Chapter *I II — "Evaluation ot* {CE)2" — contains the description of student 
populations, the evaluatLSnr design and the evaluation findings of (CE)2. 
The eva^luation of the eWorts to implement BBCE in other districts is 
suiiimarized in Chapter — "Evaluation of Implementation Activities." 
Chapter V contains a ^summary and discussion of findings and Chapter VI 
presents the conclusioivs reached by the evaluation staff and recommendations. 
The appendices contain supporting technical and descriptive information.-^ 
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The appendices have been bound separately to allow for a larger quantity 
of the basic report to be printed and a lesser -number of the appendices 
volume. The appendices will be of special interest to educational 
evaluators and others desiring more complete descriptive cui^ technical P 
information. Copies of the appendices -are available separately from NWREL. 
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Section B, Description of EBCE and (CE)>^ 



Conaroujiity Experiences for Career Education, (CE)2# is one o f four 

Experience-Based Career Education (EBCE) programs b6ing tested under the 
auspices of the National Institute of Education. Operated in Tigard, 
Oregon by a nonprofit community corporation, the prugr2un is directed by 
the Northwest Regional Educational Laboratory (NWREL) . Currently in its 
i^hird^ year of operation, (CE)2 is compos.ed of approximately 60 high school 
juniors and seniors and 7 professional staff members providing a 
cjomprehensive high school education through experiences in the community. 

A priihary goal of the (CE) 2 program has been to integrate a student's 
knowledge of a variety of careers with the acquisition of cognitive, 
interpersonal" and affective skillr through a series of plani.ed experiences 
with identified learning outcomes. Emphasis is placed on the assumption 
of responsibility by the individual student for his or her own learning. 
For- a description of the (CE)^ student goals see Section C of Chapter III. 

Four characteristics, taken together, irake {C3)2 different from other 
alternative or career education programs: 

<w . ^ 

1. The learning program evolves from adult activities in the community, 
tt is reasoned that if the learning activities are based directly 
on adult tasks and rc^.es in the community, learning will *be 
recognized as morr=i releVcint by youth in preparing for the transition 
to adulthobd. 

2. The prograni is based on experiential learning, actively involving 
students in the daily work of goitmunity life. This "hands-on" 
approach to learning has long been reco^n^zed as em effective 
learning strategy and (CE)2 is attempting to inpl^ment this approach 
in a comprehensive program. 

3. The curriculum of (CE)2 is fully integrated.' Just as the salesman 
or foreman does not think of his interactions with people strictly 
in terms of grammeu:, voced)ulary or psychology, the (CE)2 curriculum 
also applies no cirtificial distinction among the "disciplines." 

4. ^^^'2 ^ f^iiy individualized program. The learning goals as well 
as the learning strategics are varied to meet the needs, interests 

" and abilities of each student. ^ „ 

« 

students in iCE) 2 spent approximately half of their time at a learning 
center in a one-story professional office complex; the remaining time 
was spent at various en^loyer and community sites. Upon con^leting the 
(CE)2 student graduation requirements (CE)2 students ^re granted a Tigard 
High School diploma. A description of EBCE program components is 
available upon request frpm NWREL.* 
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For, a brief description of EBCE ask for the Progranj 'Overview. For 
.much greater depth four separate handbooks have been developed; 
Management and Organization , Curriculum and Instruction , Employer/ 
Community Resources and Student Satvices . 
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bection C. Summary ot the NWREL Evaluation Unit's Activities 

5 

Evaluation Design 

An evaluation design was developed to include pre- and posttest of an 
experimental ctnd control group, correlational emd survey data, and a 
comprehensive case study of seven selected (CE)2 students. locluded in 
the cas6 study design were student, parent and employer instructor 
interview guides anc^a student work siLe observation guide* 

Data' Collection 

Data were collected throughout the y^ear. The total packet of evaluation 
instruments was administered to all available expexi^ental agid control 
group students in the fall and again in spring. In addition, case ?t*':dy 
observations and interviews were conducted periodically throughput the 
year and student projects and products were examined* Monitorirvg of 
totudent progress was carried out. by periodic examination of student 
records and student interviews were conducted midyear with ^ rand^ 
sample of (CE^2 students. , 

Data Analysis and Synthesis 

' Development of computer facilities and* skills to more efficiently analyze 
EBCE evaluation data occ\irred during FY 75. EBCE evaluators were 
instrumental in NWREL' s purchase *jid implementation of the Statistical 
Package for the Social Sciences ^.nd Multivariance, Version 5 , both 
excellent con^uter programs to handle and analyze quantitative evaluation 
data. These programs provide the major analytic tools in the evaluation, 
but conSideradDle energy was al'so invested in summarizing amd synthesizing 
large amounts of qualitative case study information. A SS'^page data 
analysis plan to analyze evaluat longdate by (CB)2 program goals was 
developed early in the year and is available as a separate document. 

Implementation Evaluation Design and Instriiments 

As a part of the replication effort, two separate preliminary evaluation 
designs were prepared, one to be used by school districts- who implement 
the tot^l EBCE model and one for those districts using EBCE materials ♦ - 
only. Employer, staff and fjtudent questionnaires w^re fieveloped to 
measure reactions to the use of EBCE materials. 

Evaluation qf Implementation 

NWREL' s EBCE evaluators visited many of th* full model sites and materials 
field test sites throughout FY 75. Staff memoers at these sites were 
interviewed by the evaluate rs and technical assistance, such as a 
preliminary evaluation design, was provided. In the case of the materials 
field test sites; questionnnires were administered to participants to 
ascertain their perceptions of the materials. Resujts of ^t^h^se surveys 
are summarized in Chapter IV of this reporn. 
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Participation in Conferences 

Members of the EBCE evaluation unit attended various NIE-sponspred 
evaluation meetings throughout the year. In addition, a paper dealing 
with the FY 74 evaluation results of (CE)2 was delivered by the evaluators 
at the u^nnual meeting of the American Educational Research Association in 
Washingt<^ D.C. 

A series of papers dealing wilsh.the use of multiple strategies in the 
evaluation of EBCE was prepared and presented at the annual meetings of 
the Pacific Nortl}west Educational Research Association in Seattle. 
This series of papers has been accepted for publication in the Research, 
Evaluation, Development paper series of NWR\.L. ^ 

IniJ cooperation with the project director and coordinator of the 
implementation unit/ a member of the BBCB evaluation unit participated in 
the planning and delivery of two-weeH regional presentations co state 
-coordinators of career and* vocational education. This was in connection 
with conferences held under the auspices'^of Part D, Vocational Education 
Act. Initial planning has also occurred in developing an evaluation 
package for next year that will assist school districts in evaljuating 
EBCE programs. 

Cooperation with External Eyaluator 

EBCE evaluators h^ve cooperated with the external evaluation contractor, 
Educationl Testing Service (£TS) , in recommending selected evaluation 
instruments, reviewing ETS-developed instr^pients, critiquing ETS's 
b^avioral observation report and preparing student and employer lists 
requested by ETS. The ETS anthropologist studying (CE)2f was provided' 
with necessary background information and current evaluation data and 
participated with EBCE evaluators in the paper series on the use of 
multiple strategies in the evaluation of EBCE. 

Reports to NIE 

•» 

A first quarter evaluation rt^ort was prepare^ that summarized pretest 
data' and was included as an appendix to the regular EBCE quarterly 
report 'to NIE* An interim case study report was prepared and sent to 
NIE ill January. The purpose of this inter:^.m report was to inform NIE of 
the expected scope of the case studies and to elicit NIE and other 
professional feedback on the use of this methodology. Statements a±>out 
progress in completirjg evaluation milestones were included in the NWREL 
quarterly reports to NIE. 

Finally, the preparation and writing oi this final evaluation report has 
"been, itself, a major evaluation activity for FY 7S. Several summaries 
of this report (at different levels of detail and prepared for different 
audierites) will be written to make the information' in this ^report more 
accessible and meaningful to various audiences. " 



ERLC 



17 



8 



CHAPTER III . EVALUATION OF (CE ) ^ 

X ' • • • ' ^ 

Section A. Student Populatioiis . 

Evaluation data were collected thrqi^ighout^' the FY 75#prograin year from five 
groups of students. A definition of these five groups and a description 
of background and baseline data follow. 

Definitions 

1. True Experimental Group 

Thirty-one juniors and seniors randoirly^ assigned to the (CE)2 program 
from the total pool of applicants to (CE)2.. THis is the primary 
group for comparisons in the experimental design. 

2. Preselected Group , , ^ 

Thirteen highly motivated juniors and seniors admitted to, the 
ptogram to countierbalance the disproportionate number of returning 
seniors' (see three below) judged to be low in oKDtivation. Because 
th^se students were not randomly assigned to the program, no direct 
comparisons were made between them and the "true" control group 
(see four below) . ^ 

3. Returning Seniors 

Eighteen seniors who were, juniors in the (CE)^ program for all or 
part fef FY 74. Thcs^ students, together with groi^^ps one and two. 
above, make up the entire (CE)2 student population^ 

4. , True Control Group 

Forty-four juniors^ and seniors from Tigard High School (THS) < were 
randomly assigned to the control group from tne total pool of 
applicants to the (CE)2 program. Seventeen of these students 
dropped out of school prior to pretesting and two more were not . * 
• available for testing, leaving a pretesved control groUp of 25 
students. Only 12 students were available for posttesting. 

5. OflE Con^arison Group , ^ 

Twenty^five students participating in the Diversified Occupatdons 
Cluster of the Cooperative Work Experience (OWE) program at Tigard 
High School. These students were used to compare career knowledge 
of students in an alternative career education prpgram with that of 
(CEy2 students. ' • 
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Background Data ^ 

— \ "^^ * 

An examination of the student demographic information collected in the 
fall (see^ Apjj^ndix shows the-^rue experimental group to be very similar 
to th^ true control group. This wo"ld be expected because of random 
assignment. \ r . 

» %k 
Summarized in Tablie 1 are tenth grade School and College Agbievement Test 
(SCAT) scores and cumulative Grade Point -Averaye (CPA) for all groups 
except the CWE students. For comparison purposes ^ data from a random 
sample of Tigard High School students (FY 74 THS Random Sample) and from the 
FY 74 (CP) 2 PQPulation have been included in Tabl^l. 

Table 1 

^ TENTH GRADE SCAT SCORES AND GPA OF 
(CE)2 AND CQMPARI^^'^N GROUPS 







Group 


c . Score 












FY 75 


PY 74 
















THS 










Ret. 


Pre. 


(CE)2 


THS 


Rein. 


FY 74 






Exp. 


Srs. 


"Sel> 


All^ 


;,Con. 


Sam. 


(CE)7 






48.8 


43.7 


59.3 


49.1 


48.6 


51.3 


45.9 


SCAT^ Verbal 


s 


8.4 


10.4 


t.4 


10>2 


8.9 


8.6 


9.1 




n 


29 


17. 


10 


56 


21 


63 


34 




X 


44.8 


42.7 


62.8 


47.4 


45.2 


51.3 


44.7 


"^SCAT Quantitative 


s 


7.5 


8.9^ 


6.8 


lOte 


10.0 


9.8 


8.6 


* 


n 


29 


17 


' 10 


56 


21 


63 


34 






















X 


46.6 


43. .2 


62.4 


4d.4 


47.0 


51.4 


44.8 


SCAT Total 


s 


7.4 


9.5 


6.2 


10.3 


9.2 


9.0 


8,. 4 




n 


29 


17 




56 


21 


-63 


34* 




X 


2.42 


2.19 


3.27 


2.58 


2.42 


2*'81 


2.11 


GPA 


s 


.50 


.62 


.39 


.63 


.54 


.72 


.65 




n 


31 


9 


12 


52 


21 


70 


38 



* 'X group means; S « standard deviation; n = number of students per cell. 



These scores generally ara consistent* with (CE)2 staff iudgroents about 
subgroups of students within the (CE)2 population, the returning seniors 
as a group Exhibited the lowest^retest achievement scores ;»nd the ' 
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preselecrter^, highly motivated group exhibited the highest pretest scores. 
The scores of the randomly selected experimental group are comparable to 
the scores of the control group. The total FY 7S (CE) 2' population reflects 
higher achievement leveA than did the FY 74 (CE)2 stydent population, 
but somewhat lower achievement levels '.han a random sample of FY 74 THS 
students. 

Student Att rition 

— « 

Displayed ii> Tablfe 2 are the numbers of students in each group at pretest 
time and again at posttest time. 

. Table 2 < - 

NUMBER OF STUDENTS IN. (CE)2 AND CX)NTROL 
GROUP AT PRETEST AND POSTTEST TIME* 



Group 


Pretest 


Posttest 


Differences 


Experimental 


31 


30 


• A * 


Returning 
Seniors 


18 


10 


8 


Presd'lected 


13 


12 


\ 


Control 


25 


12 


13 



* .Throughout the report the number of subjc?cts*in each group 
, \ „ varies since all subjects cfid not completer all instr^junents. 

o 

s . 

Educational Testing Service (ETS) , retained by NIE as an external 
evaluator of EBCE, conducted follow-up interviews with (CE)2 and control 
students who did not complete the school year. These data will be^ included 
^in the ETS evaluation repori: diie-in— DecemtoeT""r975. " 

.^Because of the high rate of attrition from the control group, the 

representativeness of the posttest sample was questioned. Accordingly, 
analyses** of pretest data comparing the control group dropouts with 
those control gtoup students who reroaineu in school were conducted (see , 
Appendix B for- means and summaries of the analyses). 

T'he analyses indicated that the differences 4)etween the groups^ were not 
statistically significent. (This nondif fereuce may be the result of the 



** Multivariate Analyses of Variance (MANOVAs) . 
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low number of students in both groins which makes the analyses a very 
conservative indicator). An exanAn^tion of groi^x means on meeraures of 
academic achievement, indicates that those who "dropped out" of school from 
the control group scorned 2.0 grade equivalent years hxgher on reading 
comprehension, 0.6 years higher on arithmetic concepts and 1.5 years 
higher on arithmetic application^. Scores of the dropouts on attitudinal 
ineasures were substantially (though again not significantly) lower > 

Thus, there is some evidence that the control group tested at the end of 
the,,y€?ar may not be representative of the same population as the 
experimental group. All con^arisons within the experiotental design 
between these two groups must be tempered with this knowledge. 
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Section B, Evaluation Design Summary 



This section summarizes the goals, strategies and data analyses used in 
the evaluation of (CE)2. A more detailed description of these strategies 
is available in the EBCE FY 75 Data Analysis Plan and in the FY 75 First 
Qvtarterly Report for the Experience-^Based Career Education Program , 



(CE)2 Student Goals 



The NWREL EBCE program goals and objectives are divided into two categories: 
. ia) student outcome ^oals and objectives and (b) product development goal^ 
and objectives. Student outcomes include changes ip stiidehts which were 
anticipated to take plac0# such as ^increased reading ability, increased 
personal management skills and increased knowledge of careers. Products 
Include forms, documented* procedures and systems developed by the staff 
that were essential to the operation of the EBCE program. Exanqples 
include student records, eB^loyer recruitment procedures, site £malysis 
procedures and the student, accountability system. ^ " ' 

The FY 75 student goals and objectives follow in this section. The product 
develoimient goals and objectives are 4if:ted in the FY 75 0|>eratinq Plan . 
Documentation of product develofmicnt goaX attainment is recorded in the 
quarterly 14WREL EBCE reports to NIE. 

o 

student outcOTie goals were developed through a series of group meetings 
i]\volving thetfopexations, inqplementation, evaluation and management staff 
of EBCE. The (CE)2 program outcome qoals for students are organized 
beloy under the headings of Direct Outc^nes {Life Skills, Career Development, 
Basic Skills) and Other Outcomes (perceived as relating to the program as 
a whole) « The first three categories of Direct Outcomes correspond to' 
major co|ji5>onents of the (Ce)2 curriculum. The last category refers to 
the broader outcc»nes of the experiential learning environment not tied to 
a specific element within the curriculum; More detailed behavioral 
objectives exist for ^ach sf the c itcome goals specified in the first 
three categories ard are contained in che^EBCE Curriculxan and Instruction 
handbook. 

" ' Direct Outcomes 

1. Life Skills 

a. Critical Thinking . Student will increase their eibility to 
gather, analyze and interpret information and to seek solutions 
to probleiAs. ^ 

b. Science . Students will increase their ability to recognize and 
apply scientific procedures and lAet^ds and be able to analyze 
the iiq>act of technology on natural envirbnments euid cultural 
values. 
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c. Personal-Social Development > Students will increase their 

ability to determine "who they 'are," "what they are," and^ "where 
they are going" and accept the responsibiiiJ:y for the effect that 
cheir behaviors and attitudes have on themselves and other - 
people. 

d^ Functioltl Citizenship . Students will increase their ability^ to 
understand democratic processes in the private sector and in 
local, state and federal government by applying those processes 
in their personal actions as well as in their relationships: to 
prifate and public^^ ins tj^tut ions. 

Creative Development , Students will increase their ability to 
identify the effects of, and participate in, the creative^ process 
of blcfnding new and/or existing materials, ideas or concepts • 
into unique forms and experiences. , / ^ 



> 



f . • Competencies . Students will demonstrate survival skills, that cover 
^ thd "economic, plemning, legal-political, healtb-rsafety, property . 
maintenance, recreational and occupational aspects of /living* 
These competencies reflect the community's perceptitshs of 
behaviors that are considered some Of the minima}, fuhclxonal ' 
requirements fpr livir\g in today's society* 

* . » " - 

Career Development 

a. Students will increase tl^eir knowledge of their o%fn aptitudes, 
interests and facilities and apply this undersVanding to their * 
potential career interests. i 

b. Students-wid±"xncrf;ase their knowledge of social, governmental 
and economic issues and trends in the world of work. 

c. Students will deyelop tne- jeheral skills of job finding,' jolD 
application, on-the-'job negotiation and dependability necessary ^ 
in daily work interactions.. 

m 

d. Students will analy^se potential careers for financial dnd 
jpsy^ological inducements, preparation needs and preparation 

programs available. 

Ba^ic Skills 

a. Students will be able to perform applied skill tasks related to 
careers of interest to tl^em. 

b. Students will improve in their performance level of the Basic 
Skills (reading, writing, oral communication find mathematics). ^ 

c. Students will bec<Mne aware of the level ol Basic Skills* needed 
*-o enter careers of interest to them and will understand the 
relationship of that level to their current Basic Skills 
proficiency. 

. 14 
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' d. Students .will demonstrate an increased willingness to apply 
Basic' Skills to work tasks and to avocational interests. 

Other Outcome's 

1. ^ Students will broaden the r«mge of sources they use (people, events, 

institutions, laws, books, etc.]||ir) gathering information for ^ork 
and decision iflaking. 

2. Students will demonstrate the ability to conduct conversation with 

an adult that reveals the, student* s self-confidence and Imderstanding 
of the ot^ier person's message amd feelings. > ' 

3. Students will demonstrate an increase in self -initiated behaviors 

. and in assuming responsibility for carryincf out and evalua-.ing tasks 
which they agree to c^nqplete. 

4. Students w. I demonstrate an increase in behaviors that reveal a 
tolerance i ^ people. and institutions who have different values, 

^ ideas Or background than themselves; an openness to change and a 
willingness €9 trust others when circiimstances warrant. 1^ — 

5. Students, will include data from their total sensory system as par.t ^ 
*^ of their input intp their decision-making processes. 

6. Students will be and feel better prepated to assume imminent adult 
responsibilities arid relationships.^^ 

7. Although not stated this year by the (CE)2 staff as an objective, the 
evaluation unit will also be obtaining data on specific job skills 
acquired by students while on learning levels at employer sites. 

* .ft 

Evaluation Strategies 

A matrix of student outcomes and the evaluation p.nStrifinents and data 
sources used to assess outcome attainment is displayed in Table 3. 
Multiple measures are keyed to each ^ student outcome and can be used as 
direct or indirect indicators of goal attainment. 

Besides this measurement of goal 'attainment by (CE)2 students, comparisons 
are alsp mad% between experimental and control group students. Because 
of the random assignment of students to the experimental and control 
groups, treatment effects on some varivablss could be tested within an 
experimental design. Table 4 summatizeis the availability of data for 
this analysis. Because of restricted pretesting time, data from certain 
scales were available for the control grou^ in only posttest form. The 
instruments are described in Appendix C 
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- Table 3 
MATRIX OF OUTCOME GOTILS 
AND EVALUATION MEASURJi^S 



• ^ primary measure 
X =- secondary measure 



DIRECT OUTCOMES—Life Skills 

► Critical Thinking 

d • Scxence 



C. Pergpnal-Social Development 



D. Functional Cicizenship 

E. Creative Development 



--Career Development 

Aptittide/ Interest & Ability, Knowledge. 



H» Social, Governmental & Economic Knowledge 



F. Competencies 



I* Jot> Application & Maintenance Skil ls 



--Basic Skills 
K. Career Applied pasic' Skills 



Baeic Skill Inyrovement 



M. Relationship of Careers with Basic Ski^s 



N, Willingness to Apply Basic Skills 



OTHER OUTCOMES 
0. Broadening Range of Souraes 



^» Adult-Oriented Eersonal Gommunic^tion 



R, 



Increasing Self -initiated Behaviors 



Increased Tolerance, Trust & Openness to Change" 
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ilensory Input as Part of Decision Making 
Preparation for Adult Responsibilities 



Spqcific Job Skills 
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Table 4 



DATA AVAILABLE FOR ANALYSIS 
WITHIN THE EXPERIMENTAL DESIGN 





Pretest 


Posttest 


Demographic Questionnaire 


X 




Comprehensive TSst of Basic Skills 


X 


X* 


Psychosocial Maturity Sca]% 


X 


X** 


Self Directed Search 


X 


X 


Semantic Dif ferenjLial « 


X t 


X 


General Questionnaire 


X . 


X 



Control group^ students received the study skills, subtests 
oniy as a posttest. 

'Controj. e^o'^p students received^only the individual adequacy 
section of the PSM as a, pretest and all sections of the . 
..instmroent as a posttest. 



Case studies of ^even (CE)2 students were also a part of the overall 
evaluation design. .The design and methodology of the case studies are 
discussed in Section E of this chapter. 

Questionnaire surveys of parcfhts of (tE)2 students and o| 'participating 
employers and indepi-h interviews of a sample of (CB) 2 and control group 
students complete tV.e evaluation design. The survey Instruments^ were 
d«»signed by ETS with input from £BCE -evaluators . ETS was also- responsible 
for survey data collection, analysis 2ur**i reporting. 

Data Analysis • ■ z > 

A variety of data analyses and display techniques have been employed. The 
type of analysis depended both on the kind of data available and on the 
purpose -for which it was collected and analyzed^ A detailed description ^ 
of the datti analyses employed is available as a 33-pag^ document entitled 
f Sce FY 75 Data Analysis Plan . summary of the types of emalyses used^is 
included hei?e.' , 

i, Step-dovm multivariate analysis of variance and covauriance — used to 
test ptetest-posttest changes on correlated dependcSnt variables and 
^ to ccaapare. experimental and control grour results.-. 



2. 



4. 



Onivariate emalysis of variance or cCvariance — used to test goal 
attainment as measiired by a jingle measure. 

RMression amalysis — used to ascertain the relatiohship between 
vetrious measures arid goal attainment. 

Chi-Square analysis — used to compare f^requency distribution of 
demographic data, student records an<f most sxirvey data. 



4^^ 



5. - Content analysis — used to evaluate student products. 

6. Case study narratives — used to analyze and synthesize data collected 
on case study S(tudents. ^ o 
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Section C. Evaluation Findings Orgcuiized Aroiind (CE)^ Objectives 



Introduction 



This section of the report contains information regarding student outcomes. 
It reports student outcomes related to program goal statements in Basic 
Skills, Life Skills and Career Development, For ease of understanding 
each program goal has been stated in the form of an evaluation question 
Following the 'underlined evaluative question relating to each program 
goal is a brief rationale explaining why that goal ip considared important; 
a discussion of (CE) 2 learning activities related to that goal and a 
summary of the evaluation findings. . ^ 

Basic Skills Outcome Goals ^ 

Th^ Basic Skills component- of the (CE) 2 program corresponds roughly to the 
"three R's." Included in Basic Skills are reading, mathematics, and 
'written and oral communication. All (CE)2 students are expected to 
participate in Basic Skills activities. 

Are students in the (CE)2 program able to perform applied skill 
ft tasks related to careers of interest to them? 

Rationale. The philosophy of^ (CE) 2 emphasizes -learning of knowledge and 
skills that are relevant to everyday life and that fan be applied feo one's 
life career. Because studfints can see the relationship between these 
sHills and life's tasks, the skilly should be easier to learn and use. 

Rel&ted Learning Activities . In thfe (CE)2 program the community acts, as 
the teacher. That is, the program developers feel*' that most learning* 
skills students are normally expected to learn in the classroom setting 
can be obta^ined in a more relevant cind meaningful way> through contact 
with the real world. Jih the program, -students are tfiven the opportunity 
to utilize the community as^ a "clasaroom. Students participate in 
exploration level and learning level experie..ces at employer sites where 
they learn what applied Basic Skills are nec^ssaxy for various occupations 
of interest to them. Students can then match the Basic Skills requirements 
demandeji by the job with those that they possess and thus identify 
realistically those Basic Skills areas in which they may need to improve. 
En^loyers are also encouraged to identify^ Basic^ Skills needs in a 
particular student. The project staff then work cooperatively with the 
en^loyer instructors in proyi<}ing any needed skills./ Basic Skills 
improvement can occur at employer sites through v^bjectives written into 
students' projects that require them to apply Basic Skills in their worK 
environment. Assistance is also provided to students through tutors 
en^loyed by the project and through selected programmed materials. 

Findings . Examination of a sample of thirty Student Performance Reviews 
(an evaluation of students completed by enployer instructors) shows a 
general positive increase in employer ratin'-^j of student attitudes apd 
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skills from the beginning of site placment to the end. No statistical 
tests of significance were run on these data because. of weaknesses in the 
scales used and the. lack of uniformity in the times at which these forms 
were completed. ' 

{CE)2 students rated this as the' ninth most effective area of learninq ir* 
(CE)2 (out 6f 21) and the staff rated it tifteenth.* The experimental group 
rated (CE)2 significantly more effective in this area, than the contro^ ^oup 
did the regular high school. 

The case study observations of students at employer sites, supported by 
iaterviews with students- and with en?)loyer instructors, indicated nuniep6us 
examples of students sucressfully performing applied B^sic 'Skill taske. 
The roost frequent examples were in comrounicating orally with adults .(in 
person or on the telephone), using basic mathematics in sales work, and in 
mciking change fo^: custoiners, an<3 reading company mateifials and personal 
materials belonging to the* en?)loyer instructors. The reading activities 
were „ often performed in corvjunct^Lon with (CE)2 projects that students 
were engaged in. 

s 

Interviews with students ^noroially indicated that they were able to perform 
the applied Basic Skills required by jobs where they were working. 

Iti general the evaluators found most' students able to perform applied Basic 

Skills required at sites where they were working. _ — - — — 

■t> -— — 

Have students improved in their performance level of the Basic 
Skills (reading, writing, or^^l communicatidns and mathematics)? 

Rationale . A young adult participjating in today's society continually 
encounters the need to use the Basic Skills of reading, writing, oral 
'communications and mathematics. Although the- <CE)2 prograun is not an 
intensive Basic Skills development program, growth in this area is an 
expected part of each students learnin^j. 

Related Learning Activities / The (CE)2 student is able to use the 
community to gain Basic Skills ^in an applied, relevant manner often 
missing in the traditional high school $etting. The tasks encountered 
at the learning level site frequently require the student to utilize 
reading, computational and communication ad^ility. This strategy forces 
the student to recognize the value pf hayir\g these skills* If her or 
his ability is lower than that needted to perform the test, the student 
is responsible for upgrading those abilities to an adequate' level. 
Upgrading of these skills is accomplished' through the, use of projects 
specifically designed to meet the student^ s needs* Independent study 
and the individualized Basic Skills program are also available to the 
student. . j . ^ 

Finding^ . Analysis of pre an^d post jdata from the Comprehensive Test of 
Basic Skills (CTBS) indicates that sjtudent$ made significant positive 
growth in reading comprehension, arithmetic) concepts and arithmetic 
applications but not in ctudy skills L i 

^ . I i 

* See Table 5 for the student and staff rating^ i^n each program^goal . 
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No differences were found between gains by the experimental and control 
groups on the CTBS. ^ 



Staff ratings of studeAt behaviors on a pre- and post basis indicate 
a significant improvement in student ability to communicate. The overall 
student rating on "con'iucts conversation- with adults that reveals hio/her 
^self-confidence" increased from 2.84 (on a five-point scale) to 3.21. 
Th§ rating on "understands another person's message amd feelings" 
jlncreased from 3.01 to 3.89. 

(CE)2 student rating of the program effectiveness in helping them attain 
Basic Skills objectives were low in all these areas. Reading was rated 
as the least effective area, arithmetic as the twentieth roost effective 
and written and oral comrounication was rated eighteenth. Staff members 
rated the Basic Skills are^^ equally low. In spite of the low ratin»^s, 
the expejrimeital students fa^ed (CE)2 significantly higher in helping . 
improve arithmetic skills than the control students rated the high school. 
Additional discussion regarding the CTBS results is contained in the 
following section of this chapter. 



Have (CE)^ students become aware of the level of Basic Skills / 
ne eded to^^enter careers of interest to them and do they understands ^ 
the relationship of that level to their current Basic Skills / 
proficiency ? " ^ // 

Rationale . The (CE) 2 program does not assume that ^11 students need to 
reach the same level of proficiency in the Basic Skills (e.g., a grade 
equivalent of 12.9 years) to enter the world of adulthood. Consequently, 
students are encouraged to Investigate the kind and level of Basic Skills 
needed for careers of interest to them and to evaluate their own Basic 
Skills proficiency and potential in light of that need. 

Related Learning Activities . Self-assessment^ and career Information 
searches on the computerized Career Information System (CIS) are one 
source of informati6n on training and skill demands of various 
occupations. The career exploration process, in which students ^fexplore 
careers of interest first hernd, and the Exploration Package, which helps 
students evaluate the demands of that career in light of their ;bwn skill 
proficiency 'play the more in4>ortant role in helping students attain this 
goal. . - 7 

Findings . When asked to rate hovj; useful their (CE)2 experiefnces have been 
in helping them know what level of Basic Skills' proficiency is required 
in the jobs of interest to them, (CE)2 rated this as the ttiirteenth most 
effective learning area. Staff members rated it' fifth, 5xperimen<;al 
students rated {CE)2 si^ificantly higher in this area thAn control 
group students rated the high school. / 

Staff ratings of student behavior indicate a significant increase in 
student activity (during the course of the year) involving applying 
knowledge of their own Basic Skills abilities to pptential career interests 
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Case study student interviews^ indicated that most students were aware of 
the Basic Skills needed to enter careers of intere' to them. SejJarate 
interviews with their enqployer instructors, however, sometimes indicated 
that students were only vaguely aware of Basic Skills needed to advance 
to higher leveli^ within d company. Although most students interviewed 
felt that they already possessed the Basic Skills needed for careers oF 
interest, some employer instructors stated that the students needed more^ 
advanced" skills than they possessed if they were to be hired as regular 
employees of the company. In a few cases, students became aware of the 
discrepancies between thexr existing level of performance in Pasic Jkills 
and what y^as required by the job and asked the (CE)^ staff €or help"" or 
purchased workbooks on their own to help in^rove themselves. 

Evaluation data gathered this year indicate that this objective has been 
achieved. - ^ 



Have (CD j students demonstrated an increased willingness to 
apply Basic. Skills to work tasks and' to avocational interests ? 

Rationale . As students j.nteract with_-comffiuni€^r-roembers and job tasks they 
Jsecoffie aware of the need in everyday life for proficiency in the Basic 
Skills. _.TJvis ^jjWareness, should make students more willing to practice 
^d apply ^Basic'r^kills. 

Related Learning jU:tivities . The total (CE)2 progrcun experiences, but 
especially experiences on employer and community sites, interact to produce 
this outcome. 

f 

Findings . Staff members were asked to rate the degree to which each 
student demonstrated a willingness to apply Basic Skills to work tasks 
and to avocational interests. Because of the subjective nature of 
observing a person's 'Villingness,**' the inter-rater reliability for this 
behavior was onJy .42. The overall mean rating did increase significantly 
over the course of the year. Observations of ^case study students aV 
various enqployer sites this year indicateUv^hat when Basic Skills were 
an integral part of a job, students were gen^r^ly willing to engage in 
them as a part of their learning level ^experienc^s^ Many of the jobs 
observed, however, required only a minimal amount an^ l^el of Basic 
Skills. . ' , 

Q 

V^en asked to what degree the (CE)2 program had helped them gain confidence 
in their ability to apply Basic Skills, (CE)2 students placed this 
area in a tie for the thirteenth most effective learriing area. Staff- 
members rated it as the eighth most effective. There was no significant 
difference between the ratings of the experimental and control students. * 

Student interest in reading, as measured by the number of books, magazines, 
and pamphlets read this year as contrasted with the year prior to entering 
(GE)2#- revealed a significant increase thus providing at least one 
indicator of applied use of Basic Skills. 
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Life Skills Outcome Goals 



The Life Skills include the attitudes and skills necessary to integrate 
the multiple roles that students will play in their iaily lives. The Life 
Skills portion of the (CE)2 curriculum builds awareness and skills in: 
critical thinking, science, personal and social development, functional 
citizenship, and creative development. Thirteen conqpetencies (survival 
skills) con^lete the Life Skills area^ 

1 . ^ Critical Thinking 

Did students increase their ability to gather, analyze and interpret 
information and to seek solutions to their problems? 

Rationale . The student faces the n^ed to make important decisions many 
times throughout his or her lifetimk. The use of critical thinking 
skills enables the student to make more often the most advantageous 
de'cision. * 

Related Learning Activities . The (CE)2 prog^^am continually forces student 
participants to develop their critical thinking skills through the use of 
two learning projects in this area per year (an individualized project 
and a preprepared one that focuses on the outcome goals) and through 
explorations on job sites. The student is repeatiedly confronted with 
the need to gather data and then use it to make viable decisions. For 
critical thinking, 'as in all Life Skills areas, all (CE)2 students are 
required to» engage in activities to iit5)rove these skills. While an 
opportunity to do, this might be available at the regular high school, 
not all students there are required t:o interact with all Life Skills areas. 

Findings . On the study skills sections of the Cong)gehensive Test'^of ' 
B asic Skillfe , which measures the student's ability to interpret a variety 
of graphic and reference resources to solve problems, <CE)2 students on 
the average increased the ^ores .6 grade equivalent years in the use of 
references. These gains were not statistically significant. 

, - c 

student attitude toward the concept^ of "decision making" as measured by a 
senjAnticT differential type of instrument did not change significantly 
ovet the course of the year. fCE)2 students were^ asked tj rate the 
extent to which they thought (CE)2 help^id them reach each program goal.* 
In doing so, they rated the critical thinking goal as the second most 
effective area in (CE)2* The experimental group rated (CE)2 significantly 
higher than the control group rated the regular high school program in 
the help they fe^'t they received in the area of- critical thinking. 
Thesa ratings can be interpreted as evidence that students in (CE)2 
perceive their program as more helpful in developing critical thinking 
skills than ^o students in the traditional program. While the (CE)2 
staff members also rated the program quite high (4.0 on the same five- 
point scale) In this area, this rating was the twelfth highest (out of' 



For a summary of staff ancf student ratings of program effectiveness 
in each of the Program Outcome Goal areas, see Tcd^le 5. 
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21 goals) of the goal ratings by staff members. 

Table 5 



'rank order of (ce)J' staff and student ratings of 
perceived program effectiveness in jeach of the 

program OUTCOMK goal AREAS 



1 • . ^ 


Group 


Program Outcxime Goals- 


Staff 


bcuaeni- 


Life Skills 








Critical Thinking 


12- 


.14* 




Science 


18- 


►21 




Personal-Sociai Development 


2- 


■4. 




Functional Citizenship 


18- 


■2i 


on 


Creative Development 


18- 


■21 


o 


-Career Development 








Aptitude, Interests & Ability Knowledge 


5- 


■7 ' 




Social, Governmental & Economic Knowledge 


17 


18 


Job Application & Maintenance Skills 


8- 


►11 


15 


Career Knowledge ^ 


12- 


14 


1 


Basic Skills 






c 


Career Applied Basic Skills 


15- 


16 


9 


6asic Skills Improvement - Reading' 


18- 


21 


21 


Basic Skills In^rovement - Arithmetic 


15- 


16 


19 


Bcisic Skills Improvement - Communication 


8- 


11 


17 


Relationship of Career with Basic Skills 


5- 


7 


13-14 


Willingness to Apply Basic Skills 


8- 


11 


^ 13-14 


Other Outcomes 








Broadening Range of Serviqes 


2- 


4 


12 


Adult-Oriented Personal Communication 


1 




11 


Increasing Self-Initiated -Behaviors 


2- 


4 


4 


Increased Tolerance, Trust & Openness to Change 


8- 


11 


7 


Sensory Input as a PaJt of Decision Making 
Preparation for Adult/Responsibilities 


5- 


7 


10 


12- 


14^ 


6 



When there is a tie in the rank order of goals rated, thi^ is shown 
by using the same rank orders for the liied items. Rank order rather 
than means was used because most goals Ireceived high ratings on a 
five-point scale » ' 



In the critical thinking preprepared project, students were rcrquired to 
(a) demonstrate an understanding of (CB) 2 staff relationships and 
learning resources, (b) describe (CE)2 involvement with employer and 
community sites, (c) describe the relationship of (CE)2 and Tigard High 
School, Northwest Regional Educational Laboratory, and the (CE)2 Board 
of Directors, (d) select one employer site and complete an exploration 
there, (e) understand etnd explain other con^nents/strategies of (CE)2, 
(f) write a student prpject in a Life Skill area of their choice 
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and (g)*evaluate their participation in this project.* 



Ninety-six percent of the (CE)2 students eventually completed all 
activities of the preprepared critical thinking project in a manner 
judged acceptable, by the learning manager. Four percent dir. not 
initiate this project. 

A saunple of six of these projects, all completed by students selected 
for the case studies, were evaluated by an external reviewer from a 
neighboring school district. 

In tfeviewing the preprepared projects in Critical Thinking titled "(CE)2 
For Yqu", the reviewer indicated sha felt this project was an excellent 
introducJtory project that helps students facilitate understanding of the 
^process of critical thinking through jvery practicaJU-meaRS-^ — TheTrevieweF 
gave all six critical' ttTihkihg projects evaluated a rating of five (on a 
five-point scale) in termfe,of the degree to which the students appeared 
to reach this objective. 

' c 

As part of the student case studies/ employers who supervised students on 
learning l^.vel were asked in an intervirew to judge the students'' 
effectiveness in solving practical pi^bl^ms at the site^-and vrttether ^ny 
changes l^iad been seen in the stud^t's problem solvi|ig abilities. Over 
half of the employers interviewed had not had an opportunity to observe 
the students' ability to solve problems, 7m a few ckses, however, 
examples were given where the student had recommended solutions to a 
problem that were judged useful by ''the en^loyer. a 

In summary, the evaluation findings suggest that the critical thinking 
projects are providing students with relevant experiences in the area 
but inadequate evaluation data exists to judge the extent to which 
students have internalized the critical thinking process. 

2. Science ^ 

Have students increased their ability. to recognize and appl^ - 
' scientific procedures and methods in daily life? Can students 

analyze the impact of technology on both the environment and man's 
cultural values ? 

Rationale , The existing level of technology in this country has brou'ght 
every person into contact with the influence of science. Understanding 
scientific procedures and the effects of the resultant processes ort 
the natural environment and on human values is an essential step toward 
meaningful participation in today's society. 



For an illustration of a preprepared critical thinkinq project 
containing the purposes, activities, resources, products expected 
and criteria see pages 40-54 of the EBCE Curriculum and Instruction 
haridbook developed by NWREt, dated December 1974, 



Related Learning Activitie s. The (CE)2 program attempts to develop this 
understanding through the use of projects specifically designed ^o 
involve students in the consideration of some aspect* of science. Learning 
activities require the ^udent to actually use scientific processes in 
exploring both the fact'ual background and cultural implication of a 
subject. The student may often utilize the employer site for his 
investigation; special conanunity resources are also available.. The 
projects are formulated to direct the student toward accomplishing the 
behavioral ly written learning objectives. 

Findings . In the science preprepared project, titled "I Was a Teenage 
Scientist" students were required tOc (a)' read information which describees 
che scientifc method and restate that process in their own words (b) write 
definitions, in their own words, of fifteen applied science terms, (c) 
identify two ways the scientific method is used on each of two employer , 
sites of their ^choice, (d) become fcuniliar with the concept of cause/effedt 
reasoning by reading, (e) identify, in two recent articles, the use of 
cause/effect reasoning, (f) identify four examples of cause/effect 
relationships on two employer sites of the student's choice, (g) indentify 
and discover the extent to which precision, accuracy and self-discipline 
as traits basic to scientific methodology existed at an employer site of 
the student's choice, (h) write a summary of what was learned aboxit 
scientific procedures at a job site and how well the student's own "traits" 
match them, (i) broaden their concept of v^at topics are legitimate 
sources of scientific inquiry b> brainstorming ten areas on the employer 
site that could be legitimate science areas, (j) select a problem on the 
employer site, apply uhe scientific method to it and carefully document 
the results, (k) evaluate ^he application of the scientific method to 
problem solving.* 

Eiglvty-three pS^cent of the (CE)2 students successfully completed the 
requirements for the science preprepared project and were certified by the 
learning manager as having accomplished all the above mentioned tasks and 
activities. Ten percent of the students did not initiate this project 
and eight percent began but did not coir?)lete it, 

A sample of 10 science projects, all con^leted by students in the case 
study sample, were evaluated by an external reviewerv This evaluation 
indicated that the reviewer regarded the science proj^ts as more than 
adequate to help students attain the science outcome goal. 

Students rated the science outcome area as tile sixteenth (out of 21) 
most effective learning area in (CE)2. The exi>erimental group rated * 
(CE)2 significantly higher in this area than the control group rated 
the regular high school. Staff members rated this as the eighteenth 
(out of 21) most effective learning area. 



For a complete description of the purposes, activities, resources, 
products and criteria for the science preprepared project see pagt^s 
59 to 68 of the EBCE Curriculum and Instruction handbook/ dated 
December 1974, 
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The eva'luators fee'l^ that student science projects have provided the best 
evidence for accomplishment of this objective. 

* 0 

3 . Pergonal -Social Pfetrelopinent ' / . ^ 



Have students increase^! their aibility to determine" "Who they arej. " 
' ".tl^idt they are," and "Where they^are going?" Do they accl5pt the 
responsibility for the effect that their behaviors and attitude^ 
have on theirselves cuid on other people? _ — - — * ' ' 

Rationale . Personatl management skills, including mental health skills, 
self-anctlysis, self-direction emd an understanding of responsibility are 
essential to life adjustment. The student's personal well-being as an 
adult depends in large part on, the aU^ility of the i^dticational system to 
reinforce growth in these areas'. 

Related Learning Activities . Several aspects of the (CE)2 instructional 
system are ^designed to provide direction to the students 's personal and* 
social development.- As in all the Life Skills areas, students working 
in this area use projects to help them achieve the designated outcome 
goal. In addition, students face many of the responsibilities required 
of mature adults when they participate at en^loyef sites. Getting along 
with coworkers, being or time and having a respect for property Are only 
a few examples of the "working world" habits that a (CE)2 student must 
develop. ' * «• 



Activities of the student/staff retreats, Wednesday student meetings 
and individual work task 1 negotiations between staff and students also 
provide an-^pport unity for the student's personal and social improvement. 
A program accountability \system is in operation. This system helps 
students understand the importance of adhering tg established procedures. 
Rewards and penalties arelemployed to help students become more 
responsible for their own toehavior. The progreun's structure also 
provijJes each student withi substantial opportunities for receiving 
counseling and guidance frci^m staff, employers and coimnunity individuals 
and agency personnel. • ; „ 

Findings . On the Psychosocial Matutity Scale (PSM) (CE)2 students on 
the average did not demonstrate significant change on their individual 
adequacy scale scores due partjy tp having received high scores at the 
beginning of the year. This Scale is designed to measure a student's 
perceived adequacy in relationship to work, self reliance and knowledge . 
of him/herself. Significant positwe change was registered, however, 
on a semantiKT differential instrument that measured attitude toward the 
concept of "me." 

On an instrument with which staff members rated (CE)2 students on a , 
pre-post basis on seven behavioral scales, a significant increase in 
behaviors^ was noted that dempnstrate that^ students know their own 
aptitudes, interests and abilities* Students were also rated 
significantly high at the end of the year on a scale called "Assumes " 
responsibility for carrying *out tasks." 
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on the perse :1 an^ social development preprepared project, students, were 
asked ^o (a) make a list of their strengths and weaknesses, (b) identify 
an observatele /behavior they exhibit at an en^loyer site and would like 
to change, (c) do a force field cmalysis for this behavior, (d) carefully • 
observe this behavior at an en5)loyer site and record the data (e) ^ 
interpret the" information collected cibout themselves as it affects other 

people, (f) plan and carry out a strategy to change^ the _behavior^ ^7 

(including settjjig_jajceali^i« -goafi^ timeline, implementing 

"ttTe^^pIan, evaluating progress and, if needed, considering alternatives) ,- 
(g) be a participant observer in a group 'activity witlji the intention of 
describing behavior in non judgmental terms r (h) identify an adult and 
have him/her observe them in a group situation and give feedb^ack on ^roup 
process skills, and (i) evaluate performemce on this project to isolate 
the part that was most difficult o^r challenging and initiate another 
project in that area** ' « 

Ninety percent of ^e (CE) 2 students were ju3ged by the staff as 
successfully convicting eaph of these personal and social development 
activities-; Eight percent of the students did not begin this project and 
one student began but did not finish it. ' 

Eight personal and social development projects were reviewed by an external 
evaluator who rated all eight of them as. very appropriate (five on a 
five-point scale) -^r helping student.' attain the personal emd social 
development goals. p 

Case study interviews with students and staff havfe provided 'illustrations 
of how students have been helped to accept responsibility for their 
actions. The most concrete exanples of this have occurred where students 
have failed to show up for an appointment with an en^loyer, community ^ 
resource person, or staff mentoer. Students are made aware of their \^ 
behavior, how people react to it and the consequences. Other critical 
'incidents have also been documented in the case st;udies where students 
fall substantially behind in cpnqpleting their (Cr)2 tasks and are 
requiced to make the big decision whether to catch up or to leave the 
•program r \ ^ 

Personal and social development outcome goals tied with critical thinking"^ 
goals as the second most effective area of learning according to the « 
(CE) 2 "student ratings. The experimental group rated (CE)2 significantly 
higher than the control group rated the 'regular high school. ' St'aff 
jnembers also rated this as the secoridj most effective outcome a2;ea. 

Based upon the evidence gathered this year, the evaluator^ feel" that 
this goal*" hafi been* achieved^ i ^ 



* For an illustration of .this project see pagers 91 to 111 of the EBCE ' 
Curriculum and Instruction handbook. 




Functional Citizenship 



Have students increased their ability ^^o understand democratic 
processes in the locaLr^state and- federri-^overnffients aina~irr the 
private'sector? Do they apply those processes in the^r personal, 
actions as well as in their relationships to private and public^ 
institutions? 

a Rationale . There is probab^ little question that an increased awareness 
of the workin<^5 of ^oyi^mthent art4 the responsibility of citizenship is 
highly beneficial to both the. student and to society. The daily 
application of democratic princi^J.e^ combined with a knowledge of the 
framework of our governmental system <:cm do much toward' helping the 
student become an' e^^ective citizens * 

' . f- 

Related Learning Activities . The (CE)2 progra«uattenq?t^, through use 
of carefully designed' projects, to place the students into a learning 

^situation where^ their own efforts ^will\ lead them to discover the role 
citizenship plajys in developing a well-^^ounded member of the .adult world. 
In addition, fiive of the student competencies relate directly to 
citizenship obiectives (e.g., "understand, the basic .structure and ' 
function of local*,.. state an<} federal g9Vjernroent, " "explain one's own 
legal rights akd responsibilities"), Thje^tudent accountability ^ystem 
encourages students* to be responsible foXi planning thai* pwn learning 
program and coordinating own day-to-day activities. Finally 

through the process of student staffing/^ student progress in the area of 
personal responsibility^ is monitored ar^d individualized^ activies are 

^planned. 

Fijicjings . Sixt^-three percent of th^ (CE)2 student population 
successfully 1 completed each of the competencies dealing with* civic and 
political skills* ThiiS is slightly /^ewet than the average number of ^ 
studei^t^ ^obtaining certification on^'the other non-"citizenship" 
competencies/, {-76 percent) • This suggests that the citxzen^ip 
competencies are either- less popular or areT regarded a^ more difficult 
than othei competeHcies. ' * * 

it 

(CE)2 students gave this^the secon<^ lowest effectiveness rating of all 
the ^21 learning areas. The control group also rated the high school verx 
low in this cirea and there were no significant ^diJ^erenc^s-^jetweerTThe^ 
experimental and control grou|5's l^at?i^gs:: S^taff mejribers rated this area 
^ low, putting it in a three-way tie for last pl^C^, * ^ . 

' ■ ^ ^ 

In the functional citizenship preprepared project, students were asked 
to (a) describe derooctacy by comparing how well it*^ works now wi 'h the 
ideals set forth in the const ^J^uticyn and by giving exan^les of three 
different levels, on which it works, (b) investigate other governmental ^ 
forms of decision making by observing decision making process^ at 
employer sites, (c) diescribe their own role in decision making at home, 
with friends, oji employer sites and-at the •(CE)^ learning center, (d) 
select one social problem of interest and/of iipportance and invest;iaate 
the type and cunount of citizfen and special "interest involvemenli, 
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(§) identify and examine two types of business taxes on an employer site, 
(f) identify and discuss (in terms of purpose, how coliectec}, how 
computed, how it is used and why it is necessary) four iCinds of taxes 
_which'^thEy as a citizen will be required to 'pay, (g) descriljie how state 
and/or federal codes govern working conditions- an employer site, 
(h) define citizenship, (i) list five examples of individual participation 
in the government decision-making process, and (j) select one citizenship 
activity from a list and participate in it.* 

.Sixty-nine percent of the (CE)2 students su^essfully completed all the 
activities from the functional citizenship preprepared projects and ^ 
received the staff sign-off. Tweynty-five percent of the students did'^not 
initiate this project ancj^six percent began but did not complt w^-dTt . 

\ °- 

An outside, evaluation of 8 projects of students in the cai^e study sample 
rated seven of the projects as definitely able to h^l^ students attain^^^ 
the citizenship goals While one was judged definitely not appropria^te for 
this Life Sl^ills area. 

\> 

The"case" study Of G e orge ~ provides^ --fi:€h^-^UJaistxation of real life 
experiences lihat some of the {CE)2 students have had in par^ieipatJJi9>^^ 
actively in the democratic processes of go^^ernment. Geotige and-^another 
student spent ^ two weeks living in Salem eind working, on '^various projects 
with a 6tate r'epresentative. . 

- 

A comparison of the (CE)^ experimental and control group on the student 
End of Y.ear Questionnaire revealed that a significantly larger nunibor of 
(CE)2 students attend pxiblic meetings than was true for the control group. 

Based upon thb available Widence, the evaluators feel that this goal 
jwas achieved for most of th€ (CE)2 students. 

5. , Creative Development 

Have students increased their participation in the creative process 
of blending new and/or existing mat^rials^^dea^-or concepts into 
unique _^ban&^nd^"e^g^rl.^nces? Can they identify the effects and 
desirability of these creative experiences? \ 

Rationale *., .Education in the traditional setting Often concerns itself 
primarily with a repetition of p^ist facts rather than stressing 
individuality and creativity in the present. Creativity is an essential 
element of self-expression; the development o^ one's creative abilities 
is cm in^rtant step in satisfactory overall growth. 

l^lated Learning Activities . Student learning* projects in the (CE)2 
program are chosen to help direct creative growth. Two projects during 
the year are intended to provide each student with an opportunity to 
trarisfontt one of his or her own interests into a unique and creative 

■ / 



For an illustration of a functional citizenship preprepared project 
seef pages 69 to 80 of the EBCp Curriculum and Instruction hondbopk. 

" ' • 30 

40 



learning experience that does not perpetuate th** often irrelevant methods 
of the typical curriculum. 

Findings . tCE)2 students ratdd the creative development area of (CE)2 
as the eighth most effective of the 21 learning areas. The experimental 
group rated (CE) 2 significauitly higher than »i:h6 control group on this 
variable. In tfie staff ratings the creative develojgsient area tied as 
the least 'effective learning area. 

In the creative developmeot preprepared project, students were-' asked to 
(a) describe in their own wrds what creativity is, (b) collect 
photographs of common things that exhibit Creativity and describe what 
makes the3e things' creative, (c) desfcribe the differences between style, 
discovery and creativity, (d) wxth the help of the employer instructor, 
identify an example of creativity -that has inqproved the operation of 
business, (ef identify five examples of creativity expressed in 
different forms in the comrounity and explain v^at is creative about them, 
(f) after reviewing recent articles on advertising, explain the function 
of creativity in that field, (g) prc^pose three solutions to a problem 
at an employer site and with the employer instructor discuss the 
creativity of their Solutions, (h)^describe themselves as creative beings 
and (i) redefine creativity based on their experiences with this 
project.* ' " ' 

Eighty-eight percent of the (CE)2 students successfully accon^lished the 
tasks laid out in this project and were approved by the (CE) 2 staff. 
Twelve percent did not initiate this project. 

An outside evaluation of seven projects coit5)leted by the case study 
students indicated that six of. the projects reviewed wene judged as very 
appropriate to help students attain the creative development goal. One 
prdject was rated only slightly lower. In the opinion of the evaluators, 
adequate evidence exists to support the achievement of this goal. 

' n 

6. Conypetencies 

Have students demonstrated surviva l skills that cover the econ<jmic, 
planning, legal-political, safety-nealth^ property maintenance, 
recreational and occupational aspects of living; i.e,, can students , 
perform behaviors considered by the community to be some of the 
minimal functional ^requirements for living in today's society? 

Rationale . A critical aim of the (CE)2 program is to provide students 
with the opportunity to learn skills considered essential to thei^r 
survival in the adult world. Competencies such as responding to 
emergencies or holding a job are required of mature members of society. 
Quite, often no segment of the traditional high school curriculum '^ill » 
consider these mandatory Life Skills, dwelling instead on moi^e 
academic but genera) ly less relevant topics. ^ ' 



♦ For an illustration of a creative developitent preprepared project; see 
pages 81 to 90 of the BBCE Curriculum and Instruction hamdbook. 

1 " 



Relate'd i!earning Activities , in the (CE) 2 program information is made 
availc ^e to the stucjents to direct their independent learning of the 
con^etencies. Students study until they. feel secure in their 
ability .to perform on^* or more of the competency tasks. An expert in 

• the community is then contacted to act as the "competency certifier." 

. Students demonstrate their ability to perform the competency ttx this 

expert who, if satisfied, certifies .that the student does in fact possess 
the required Ufe Skill. The 13 (CE)2 program competencies are: (a) 
transact business on a credit basis; (b) maintain a checking account in 
'good order; (c) provide adequate insurance for- self, family and 
possessions; (d) file state and federal income tax statements; (e) 
budget time and money effectively; (f) maintain the best possible health 
and make appropriate use of leisure time; (g) tespond appropriately to 
police, fire and physical health emergencies; (h) jjarticipate in the 

. electoral process; (i) understand the basic structure of local, state 

* and federal government; (j) explain one's own legal rights and 

responsibilities; (k) make -appropriate use of public agencies; (1) make 
application for employment and successfully ho.ld a job; and (m) operate 
^ and maintain an automobile.* A student is required to complete at least 
half the competencies each program year and all of the, competencies to 
graduate from the program. 

f ' 

F^indings . ^ The number and percent of students certified as having^ 
successfully completed each competency in FY 74 and FY 75 are displayec" in 
Table 6. These competencies are certified by experienced members of 
the community. Since the program has operatec^ with approximately the 
same number of students in each of .tHese two years it is interesting 
, to note that a substantially larger proportion of the students have 
completed competencies this year in cqmparison with last year. 



* For a description of the activities required to complete each of 
these dompatencies see Appendix J of this report. 
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Table 6 

. NUMBER AND PERCENT ' OF STUDENTS . COMPLETING 
EACH • COMPETENCY IN FY 74 AND FY 75 



■ ■ M - —■■ ■ . _ 


FY 74 


■ . FY 75 


Competencies 
Certified 




* or 
Students 


Tnt- A 1 


OX- 

Students* 

Cil IX yJl. xcu 


1. Transact Businessmen A Credit 
Basis- ^ 




c 

Q>l 


52 


98 


2. Maintain a Checking Account 
in Good Order 


45 


90 


51 


96 


3. ProvJ.de Adequate Insurance 
for Self,. Family and 
Possessions 




CO 

Do 


A A 

44 


83 


4. File State and Federal 
Income Tax 


28 


56 


38 


72 


5, Budget Time and Money 
Effectively 


1 7 


J** 


Jx 


D9 


6, Maintain the Best Physical 
Health and Make Appropriate 
Use of Leifeure Time 


10 


20 


23 


43 


7. Respond Appropriately to 
Fire, Police and Physical 
Health Emergencies 


24 


48 ■ 


42 


79 


8. Particioate in the Electoral 
Process 

— — - 


8 


16 


33 


62 


9. Understand the Basic 

Structure and Function of 
Local, State and Federal 
Government 


6 


12 


24 


45 


10. Explain Ovm L^gal Rights and 
.Responsibilities 


5 


10 


29 


55 


11. Make Appropriate Use of 
Public Agencie^B 


17 


34 


44 


93 


12. Mcdce Application for 

Employment and Successfully 
Hold a Job 


28 


56 


46 


87 


13, Operate and Maintain an 
Automobile 


17 


34 


31 


59 


Total * 

L 1 


281 




488 


. — . 



These data indicate that some competencies are attained by students much 
more tfian others. For example, the physical fitness coii5>etency was 
completed by 43 percent of the students while the credit competency was 
con5>leted by 98 percent ''of the students. 
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Career Development Outcdme Goals * 

The Carreer Development component of (CE)2 has the goal of providing 
students with the opportunity to explore and learn about specific "^-^ 
careers at joD sites, while at the same time enad^ling them to learn more 
about their own interests and aptitudes and how they fit into the v^orld 
of work. 

Have (CE)2 students .increased ♦•heit knowledge of their own aptitudes > 
interests and cd)ilities and applied this understanding to thej.r 
potential career interests ? 

Rationale . The (CE)2 project staff consider a mature career' choice to be 
one in which a person matches a knowledge of her or his own aptitudes, 
.int:erests and abilities to the characteristics related to a given ^ 
occupation. Such a match requires an adequate knowledge of self. 

Related Learning Activiti es. (CE)2 students, are required* during each ' 
program year to use at least five different employer learning sites for 
exploration level experiences. Each exploration level lasts 
approxinjately Lhree to five days. During and after completing each 
exploration level, the students obtain career information^ such as 
company policies, nature of the work, work environments, qualifications 
and preparation required, earnings and fringe benefits and future 
employment prospects. The exploration level also develops and 'enhances 
the student's abJlity to understand her or his interests, abilities and 
skills yind to match these with job characteristics. 

# 

Other resources used by (CE)2 students to help them better understand 
theTr own aptitudes^, interests emd abilities and their relationship to 
potential careers are the Self Directed Search (SDS) and the Career 
Information System (CIS) . The Self Directed Searc h is a self- 
administered inventory of educational and vocation ilanning in which 
the student identifies preferred activities, con^tencies and 
occupations. The Career Ir formation System , developed by the University 
of Oregon in cooperation with several other agencies, is an interactive 
computer progreun that students can accesG whenever they wish on the 
(CE)2 terminal. This computer system helps the student to identify and 
match certain personal and job characteristics such as physical 
limitations, preferred location for living and working, education and 
^r^ining requirements, aptitudes, interests cmd job earnings. Information 
from both of these instiuments was used to guide students in the 
selection of appropriate job exploration sites. 

f'indings . No significant changes, except ^or an increase in the 
Realistic co4,e, were noted in the (CE)2 s.tudents as a group on the 
Self Directed. Search , an instrument, yhich among other things, mec.sun»s » 
the consistency of a person's aptitudes, interest and self-appraiijaJ r,. 
A non-significant decline in self-f)erception as measured on the \i:>rK 
scal^ of the Ps ychsocial Maturity Scale was noted. Student attiti^Z 
toward themselves as measured by 'a semantic differential improved 
significantly. 
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On the;. student End of Year Questionnaire, 57 percent of the students in 
(CE)2 were able *o cite specific jobs that they were once interested in 
but had now determined did not match their interests and abilities. 
Thirty-six percent of the control group were able to cite' jobs* in the 
same category. 

When asked to rate the^extent to which (CE)2 helped them learn how their 
'^interests and abii-Srtles fit into potential careers, (CE)2 students rated 
this as the^i^th most effective area. Control/ group .students rated the 
regul^n^Tiigh school program significantly lower in this area. Staff 
/ ^ psf^ers also rated this as ^he fifth most effective of the 21 learning 
areas, 

•The (CE)2 staff was asked to rate each student at the beginning of the 
year and again at the end of the year on her/his knowledge of^ 
her/his own aptitudes, interests and abilities and on how much the student 
applies that knowledge to potential career interests. The averagq 
student rating increased significantly on both dimensions- It changed 
from a 2.87 to a 3,35 (on a five-point scale) on the knowledge dimension 
and from a 2^71 to a 3.27 on the application dimension. 

On the Student Questionnaire, significantly more experimental student's 
(88 percent) expressed confidence in b^ing able to con^lete the steps 
necessary to attaiti the career of their ghoice them did control students 
(57 percent) , 

Examples of how this goal is being accomplished are discussed in the 
evaluators' conclusion 3 at the end of the case studies section of 
Chapter III in this report, 

i 

Sufficient evidence exists to support the successful accomplishment of ^ 
' this goal* " 



Have (CE)2 students increased their knowledge of social / 
governmental'; and economic issues and trends of the world of work ? 

Rationale . Before a person chooses an appropriate career 3he ot he 
should have adequate knowledge of the world of work as well as knowledge 
about a particular job. 

Related Learning Activities . One of the primary strategies .used by 
(CE)2 to communicate an understanding of social and economic issues and 
trends of the world of work is that of employer seminars. In these 
seminars this year employers discussed with students procedures for 
^applying for a job, the impact of economici* on our lives, the changing 
work ethic and job discrimination, ^ " - 

Knowledge of social and^ economic issues and trends was sometimes gained . 
by students on an individual basis through exploration and learning level 
experiences and through student projects. 
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'-ihdings > The student End of Year Questionnaire contained ten items 
(items 31-r40 in Appendix D) selected from the Career Planning, Knowledge 
Scale developed by D/ J- Prediger at Ari.erican College Testing Program. 
Responses on these items were reported for a national sample of 9,307 
eleventh grade students.* These true-false items measure common 
misconceptions about the world of work such as "few women work outside of 
the home after marriage*" 'The (CE)2 experimental students responded 
correctly 65 percent of the time while the control group students 
responded correctly to^53 percent of the items. The difference in 
performance between the two groups was statistically significant, using 
a multivariate analysis of variance, in favor of '1:he (CE)2 students. In 
comparison with the national sample of eleventh graders, (CE)2 students 
scored che same or higher thcin the national sample on 8 out of 9 items. 
These same items were administered at the end of the yea'r to students in 
the Diversified Occupational Cluster of the Work Experience Program at 
Tigard High' School. This latt^^r group scored higher than the national 
sam£*le on 6 out of 9 items and was not signiiicantly different from the 
(CE)2 students.* 

Based on the above data, the evaluators feel that the goal was achieved. 

Have (CE)2 students developed the general^ skills of job finding, 
job application, on-the-job negotiation and daily work interactions ? 
Have they developed entry level work skills when appropriate? 

Rationale.' * Masteiy of genei^al and specific career skills is essential 
for obtaining and holding a job. Some skills such as being able to use 
a variety of sources to locate available jobs, writing resumes and 
interviewing for a job, and successfully interacting with supervisors 
and coworkers on a job are considered essential for all students and can 
best be mastered through. direct experiences. ^ The. development of 
specialized e^ntry level skills for a potential career of the student's 
choice has not been mandated for all students because some have not made 
a' firm choice and others are planning to enter jobs requiring 
postsecbndary preparation. 

Related Learning Activities . The (CE)2 project offers students 
opportunities for general and specific job skills through exploration 
and learning levels; emplpyer seminars, sudh as the* one on job applic^rtion 
procedures; student projects taking place at empidyer sit^S; -and the 
conqpetency requiring a stu^ient to mcdce application for employment and 
successfully hold a job. 

Fipdir^gs . A total of 87 percent of the (CE)2 student;s have successfully 
made "application for employment and successfully (held) a job" this 
"year as certified by competency number 12. This is the most direct 
measure of goal attainment in this 



* Prediger, D. J,, Roth, J. D. and Noeth, R, V.; Nationwide Study of 
Student Career Development; Summary of Results (ACT Research Report 
No. 61); .Iowa City, Iowa: The American College I'estii a Program, 1973. 
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In response to a question asking how useful (CE)2 had been in helping 
them attain this goal^ (CE)2 students' ratings on the average placed 
this as the fifteenth ,most effective of 21 learning areas. There were 
no differences in experiinental and control group ratings. The (CE)2 
staff rated this as the twelfth most effective area of (CE)2.^^^^^^^^,.^ 

The second pift of this career development goal deals with^ntry lervel 
work skills acquired^ by (CE)2 students. The Skill Deve><5pment Sheet 
which is a part of the portfolio of each student who^raduates- f rom the 
(CE)2 program lists those applied skills which wefe observed, practiced 
and acquired by students at en^loyer sites. An examination of the 
student portfolio revealed that a multitude of skills (some students have 
as Fiany as 60 identified) of widely varying natures (e.g., operating a 
keypunch, "doing" a throat specimen, taking inventory, etc.) have been 
documented. 



Have (CE)2 students analyzed potential careers for financial and 
psychological inducements, preparation needs and preparation 
programs available? ^ 

Rationale . Knowledge of finar.cial and psychological career inducements, 
training needs and resources help students plan more realistically for 
careers and career training. 

Related Learning Activities . Use of the Career Information System at - 
the con^uter terminal provides students with a quick knowledge of job 
requirements and rewards for a number of areas in which they may have 
a potential interest. Direct experience at the exploration level gives 
students a first-hand knowledge about what pcurticular jobs are like and 
6dK>ut the life style of people occupying- such positions. A more detailed 
understanding of job requirements and rewards occurs through learning 
level experiences. * 

Findings . When asked to rate the extent to which (CE)2 was helpful in 
helping them learn what to look* at in considering a job, (CE)2 students" 
ratings placed this as the roost effective of the '(CE)2 learning areas. 
The staff rated it as the eighth most effective area. T'he experimental 
group's rating was significantly higher them that of the control group. 

On a student End of Year Questionnaire's item asking students how sure 
they were of steps to prepare for and enter each of two careers they had 
considered entering after completing their education, eight percent 
of the (CE)2 students an<} none of the contfol students indicated they did 
not "know where to begin." Eighty-seven percent of the (CE)2 students 
and 57 percent of the control group students felt they would be "able to 
complete the necessary steps for entry into at least one of the (two 
preferred) jobs." The difference was statistically significcuit in favor 
of (CE)2. While these data would indicate that (CE)2 was successful in 
achieving this goal, it was disappointing to ^ee that twenty percent of 
the (CE)2 students who had been in the progrcun for two full years stated 
that they didn't know where to begin in preparing for and entering their 
two favorite career areas. , 
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student case study interviews conducted by the evaluators indicated that 
students could adequately analyze potential careers of interest for 
financial and psychological inducements but were much ^less clear on steps 
needed to prepare for sn^ch career entries. 

Indirect Outcome Goals 



Hav^ (CE)2^ students broadened the range of sources thex use 
(people^ eventSy institutions^ lawsy books^ eto-*) in gathering 
information for work and decisibn making? 

Rationale . Education has traditionally eii^hasized two primary sources 
of information that are avai3.able for students: books and teachers. The 
community- and e;cperience-based nature of (CE)2 make the community and 
life the cl'^ssroom cuid ojE>en to students a much broader range of respurces. 

Related Learning Activities * En^loyer and community site experiences 
bring students in contact with a variety of people, institutions anc} 
situations. Student projects are written to help students utilize tl-ese* 
resources and make students aware of their potential as a resource for 
a lifetime of learning. 

Findings .- When dsked what aspects of their learning experience had 
influenced their choice of potential careers^ roughly the same 
proportion of (CE) 2 and control group students indicated that teachers 
or counselors, people working in that career and relatives and friends 
had been influential. More (CE)2 students (71 percent) than control 
students (42 percent) reported actual job experience as a factor and 
more control group students (28 percent) tham (CE)2 students (17 percent) 
Reported reading as factor. 

Students were asked on the End of Yecu: Questionnaire to indicate how 
often during the year they had visited or made use of different public 
agencies or resources. Table 7 displays the percent of (CE)2 and 
control group students who reported that they had used each resource, at 
least once. 

Table 7 

PERCENT OF (CE)2 AND CONTROL GROUP STUDENTS WHO 
HAVE UTILIZED SELECTEP COMMUNITY RESOURCES 



Resource 


GrouD 


(CE)2 
Total 


(CE)2 
Experimental 


Control 


Public Library 


92.3 


85.7 


30.8 


Museum 


48.1 


46.4 


15.4 


Court 


65.4 


55.6 


46.2 


Public Meeting 


75.0 


66.6 


7.7 


College ' 




59.3 


31.8 


State Legislature 


25.0 


7. J 


23.1 
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It is apparent that (CE) 2^ students ^re utilizing most of these pubjlic 
resources to a greater degree than students in the control group. Of course? 
the nature of the program which frees students from the classroom accounts 
for somQ of this difference. The degree to which students continue to use 
these resources after graduation will indicate how well the progrcim has 
functioned- to attain this goal^ 

(CE)2 students rated this as the twelfth roost effective learning area 
while staff members rated it second. Experimental students rated (CE)2 
significantly higher in this area tnan control students rated the high 
school . 

5 

Student attitude toward the concept- of "community resources" as measured 
by a semantic differential" made a statistically significant improvement 
over the course of the year. This indicates >£hat in addition to making 
a greater use of these community resources students are' also changing their 
attitude toward them. ^ 

One of the case study students helped to clarify A\e thinking about this 
goal by stating that he felt (CE)2 graduates may not use these coiranunity 
resources' more frequently than graduates of the regular high school 
program, but that they would be more willing and able to use these 
resources as needs arose. 



Do (CE)y students demonstrate an a ^lity.to conduct conversation ' 
with an adult that reveals the students* self-confidence and 
understanding of the other person !,s message and feelings? 

Rationale . Students in a traditional program interact wi^ .1 .adults on a 
very limited basis and within the^ framework of superordinate teacher and 
subordinate student roles. ' Students in (CE)2 have the opportiinity to 
meet, talk and work with a great number of adults in a ^variety of roles. 
This experience should better prepare them for the transition to 
adulthood than the "cold start" communications experience of graduates 
of traditional programs. 

Related Learning Activities . Besides very intensive interactions with 
all staff members at the (CE)2 learning center, all (CE)2 students meet 
and talk with many adults in the community. Students interview the 
en^loyer instructor as part of the exploration process and must work and 
negotiate with employees and other community people to con^lete the 
escploration and learning level experiences and be certified in the 
con^tencies. 

Findings . Staff members rated this as the program's 'most effective area 
of learning while students rated it eleventh. Experimental students 
rated (CE)2 significantly higher in this area than the control students 
rated the regula^r high school program. 

On a rating ^orm on which staff members were asked to rate individual 
student behaviors on a beginning and end of year basis, staff members 
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indicated that students made significant growth in both aspects of 
communication listed in this goal. On the behavior^ "conducts 
conversation with an adult that reveals hi>s/her self-confidence., tXie 
average rating increased from*2.84' (on a five-point scale) to 3.21. nOn 
the behavior, "understands another person's message auid feelings," the 
average rating changed from 3.01 to 3.59. 

During the interviews with case study students it became apparent that 
these (CE)^^^^udents ^had become at ease communicating with adults. They 
demonstr^a^tei an ability ,to listen to and respond to evaluators* 
questions in a manner indicative of , their feelings of equality and 
tapport with' an pnfamiliar adult.. 

Do students demonstrate an increage in^ self-initiated behaviors - 
cmd in assumi|ig responsibility for carrying out and evaluating 
tasks which they agree to complete ? , ^ 

Rationale . In a tradi>tional high school program, stud^intc are 
"programmed" by the bell and by course and teacher expectations. , It is 
not uncommon for a student to go through school in a totally passive 
manner, never being encouraged to initiate his/her own^ activities and 
never being given the opportunity to judge the worth of hisAer work 
against his/her own value systems. (CE)2 philsophy assumed that the 
best way to prepare students for these and other life tasks is to. begin 
working on .them prior to graduation from high school. 

Related Learning Activities , \studettt project initiation, "negotiation 
and evaluation processes encourage students directly^to take 
responsibility for their own learning. The less formal atmosphere of 
experience-based learning at conipunity and employer sites also places 
students in a Situation where their own level of initiative ax)d follow- 
through determines, to a great extent, the benefit they will glean from 
the experience. \ ^ 

Findings . An interview at midyear with a random san^le of 20 (CE) 2 ' , 
students revealed a genei^^ly high level of "student involvement, in ' ' 
planning their own learning program (e.g.\, identifying topics for 
student projects, selecting Appropriate learning activities^ -choosing * 
employer iSites, etc.).. Students also describnd a high leVel ot freedom 
(and responsibility) in carrying out these leetming p^ans. Less\than 
half of the students, however, felt they played an in^rtant'role in the 
evaluation of their own work. ^' 

Both staff and student ratings on the extent to which (CE)2 helped student 
attain this goal were quite high (fourth roost effective ^for students- dmd 
a tie for second place for staff) . Control group students rated th^ : 
traditional program significantly lowier ia this area. — ^ ^ 

Staff ratings of student behaviors at the beginning of the year and ^igain 
at the end reveal a significant increase in self-initiated prpgram related 
behaviors (from "Ian average 2.74 beginning-of-the-year rating to an average 
3.19 end-of-year rating on a five-point scale). A significant increase 
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in responsibility for carrying out taisks was also described (2.91 
prerating to a 3.36 postrating) . 

Student staffing notes and those 'made'' at the end qf the student • 
accountability year indicate many stud^ts were having toJubie ' carrying 
\ out their program tasks^ Records regarding^ the nuirit)er of students behind 
\ schedule in completing projects, competencies and. other program % 
\requirements also indicate that this is a major problem for, many students 
St^udent case studies have been helpful this* year in docvunenti-ng ii? a 
pei^onal fashion the steps taken by sta^t apd students alike in helping 
students becom© more responsible., Perhaps the best way to summarize 
progr^s regarding this goal is to state that mcuiy 'teenagers are not self 
initialing, and responsible if left on their own, bujr that isijgnif icant 
improvement has«been made by many but npt all;(CE)o students in this area 

\ • ■ • ■ 

\ • . . 

Do stuCT^nt s demonstrate an iacrea^e in behaviors that reveal: a * 
ranc^ 



toleranc^ for people and institutions who have different values, 
ideas or backgrounds them themselves, an openness^ to change and a * 
willingness to trust others v^en circumstances warremt? ' ' 

rati onale . The fTlWali^m that is the American cul<ture (described by some 



as a "sa^d bowl" rather than a "melting pot") brings each citiien into 
contact with a wide riwige of values and ideas with which he/she must 
learn to cope. (CE) 2 \tten^ts to help students both "taste" and "season" 
th^ salad by learning about other people's values and by developing and 
^'expressing their <mm. ' 

... V 

Related^ Learning Activities . Rather than learn in a relatively . 
homogeneous environment ^f students and teach^er within classroom walls, 
CCB)2 students are thrust into the reSilities of everyday life. They must 
learn to talk? and work with peojple that make up all the ingredients of 
the "salad bowl.** 

> * 

Findings . The (CE)2 staff members 3:ated this as the eighth most 
effective learning area while students ijated it seventh. There was no 
significant difference, in experimental and control ^group rating' on this 
dimension # * - * ^ 

On' the Psychosocial Maturity S^ale, (CE)2 students at the beginning of 
th^ school year already , scored high on the trust , tolerance , and 
openness to chcinge scales a'n'd thus there wa^. relatively less chance than 
last year of showing significant growth in these areas. Ne^wrtjieless, 
the (CE)2 .students did demonstrate a significant gain in trust and 
openness to change , . and a marginal decline in tolerance. 

The case studies conducted this year included interview questions to case 
study students and their employers that dealt with the students* 
ability to relate to people with different values and background^, 
students' openness to change, and 'the i^ willingness to trust others when 
circumstances warrant. In some cases, employer instructors had not had 
sufficient time to judge students on these traits. When employer 
instructors did respond and present^^qxauhples, they usually supported the 
students' positive performarjce in *these areas. Tolerance and trust, 
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however, were difficult* areas to pinpoint, , , 

Because these three traits of tolerance, trust and openness co change are 
difficult to observe except • .en they are violated, the evaluators feel 
that insufficient dat^ exist to judge the achievement of this goal. 



J DQ students include data frOm their total sensory system ^s part of 
thgir input into their decision-making" process? v 

Rationale . Education has for many years emphasized the cognitive nature 
of learning and has ignored or d€<-eiiyphasized the affective ^onatin, (6E)2 
emphasizes aH aspects ^of learning and wcourages students to considgx 
all data — cognitive, affective and sensory data (as it affects the / 
cognitive and affective} — in the decision-m^ing process. 

Related L3arnirfg^Activities > Because (CE)2 is experience based, students 
in the normal course of eyerfts encounter multiple sensory input (as > 
opposed to the vicarioijs' learning in a crass^room). , The career 
^exploration process eacourages them to use this input as real data in 
the decision making process. 

Findings * Although no significant ch2uige was indicated in student 
attitude toward the concept of "decision making" as measured by a 
semantic differential, (CE)*2 students r-^ted this as the tenth most 
effective learning area with the experimental students rating (CE)2 
significantly higher than the control studen^^' rated the high sqhool. 
Stfiff members ra^ed this ^^s the fifth most effective learning arfea. 

This goal has been difficult to evaluate by any means other than the 
case study student interviews. The discussion under conclusion 7 at the 
end of the case study section of this report illustrates how students 
ar'e utilizing a variet^ of information obtained through direct experience 
in maJcing decisions. Students in the casf study sam|>le were able to 
quote sound reasons, based on "hands-on" expefience for choosing to 
change career goals or to decide no£^feo-puf sue a given career. 



Are students better prepared to assume imminent adult 
rjiisponsibiliti^s cmd relationships? , 

Rationale , Few would question the goal of education that seeks to 
prepare students^ to assume adult responsibility. The (CE), ptogram is 
oriented with the overall purpose of^ easing' the student's transition to 
adulthood. » *^ 

Related Learning Activities . The whole (CE)2 pjrogram is designed to help 
students become responsible adults, but the Student Accountability^ ' , 
System is the roost direct strategy to effect this outcome. Through the 
Student Accountability System, students are ^ increasingly given more 
responsibility and tne ':reedom to avoid thi^ responsibility and suffer 
the natural consequepcts of their actJ-->ns. 
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Findings , Because this goal is so comprehensive, the evaluators feel 
that it is impossible to answer adequately in a'',few words. The {C;E)2, - 
learning strategies appear consistent wj.th and supportive of this goal. 
*^ft^d^j?G are encoiiraged to reAch their own , conclusions regarding t^is 
jftoal after reading the student case rtudies and other information ^' 
contained in t^ife report. The interviews that Educiitional Testing Service 
has conducted with graduates and drop outs oZ iQE) 2 also shed some 
light in this area when they become available in December 1975, 
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section D> (^^2 Evaluation .Findings by Instrument 

Rationale for Instruments . " 

" ' * < • * 

Tha reacfer is reminded that a descriptipn of e^ich instrument discussed ' j 
in this section is found in Appendix C. This section contains the findings 
for the following instruments used in the' evrluation of (CE)2: the 
Cbmptehensive Test of Basic Skills (CTP^ , the Psych6s^ci^l Matyrity 
Scale (PSM), a semantic differential, the Self Directed Seeurch > (SDS) / a ^ 
student End of ^Year Questi^lCiaire, a Staff Questionnaire and a student 
.midyear intei:view. y • - ' '>v 

The CTBS was used to measure Basic Skills "abilities and assess .growths in 
the Basic Skills areas. In order- to conserve testing tim3)\ the reading 
comprehension subtest was selected as a measure of qrowtii in verbal j 
ability ai.d the arithmetic concepts and arithmetic applications sxibtests 
were chosen as measures of gi* wth in quantitative ability. The study * ; 
skills subtests were 'used as measures of 'ability to use resource materials. 
Pretest CTBS scores were* transmitted to (CE)2 staff members to aid in 
individualizing student programs^r^hile growth measures from pretest to ' 
posfete^t administration were used to^^as^ess the kind and amount of Basic 
Skills development which occurred as a prograni^utcome in relationship to 
^growth in a traditional high school program. ^ ^ 

• \ • ' ' 

The PMS and semantic differential were used to assess growth inj^ j^r j.A f(^ > ' 
Skills area of personal-social develop!fl|nt and towards the concept of wor)c. 
In addition, the PSR was used to assess growth in th^' goal-relate<l behaviT)rs 
of self-reliance, tolerance, trusts openness to change and social 
conmitment, while the semantic diffexential was used as a measure of growth 
in attitudes towards self, learning and community resources. 

The SDS served many purposes. From an operations viewpoint it was used 
at^ pretest time as feedback to studentS'€o their career interests. F?om 
a research point of view it served r (a) to describe the career/peirsonality 
styles jof students, (b) as a change score measure of differentiation (the 
eictent jto which a student can dif fereptiate his^or her career interests) an^ 
consistency (the .compatibility of a student 's/intelests, Competencies and career 
preferences), and (c) as a reference in matching the- fit between a student's 
SDS career type with his or her two top career preferences as expressed 
on the student End of Year Questionnaire. This third research use was 
directed to a (CE)2 program gc^al of increasing students' ^ility to apply 
an understanding of their own aptit'uies, interests and abilities to their 
potential career interests. 

The student End of Year Quescionnaire measured student attitudes towards 
-(CE)2 (or t!fe high school program lor control students), knowledge of 'the 
world of Work and future work and. educational pians. The Staff Questionnaire 
was used to assess importance and effectiveness of each of the progr^.m • 
goals. The individual student interviews attempted to ascertain whether 
some of the more abstract program goals (especially those listed as other 
Outcomes in Chapter III, Section B) were being adequately addressed by 
the progi.am. 
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Comprehensive Test of Dasic Skills \ 

The CTBS reading comprehension) arithmetic concepts, arithmetic 1 
* applications, study skills using references and study skills graphic I 
materials sections were administered to all (CE)2 students in the ear^y 
fall of 1974 and again the spring of 1975, These same sections, less 'the 
study skills sections (removed to shorten the testing time) , were \ 
administered to the control group students in the fall. All sections 
were administered to the control group in the spring. 

The CTBS was used to mr ^-r-^ change in students* Basic Skills achievement. 
It was hypothesized that 2 students would improve their Basic Skills 
achievement and that thelY growth in this ar^a .would not be less than 
that evidenced by their counterparts at the high school. 

Expanded standard score group means and standard deviations on the pre-- • 
and posttests are included in Table 8. 



Table 8 

^''£TEST AND POSTTEST EXPANDED STANDARD SCORE MEANS AND 
^STANDARD DEVIATIONS OP THE (CE)2 AND. CONTROL GROUP 
THE COMPREHENSIVE TEST OF BASIC SKILLS* 



^'^'"'•x,^ Score 
Group 


Reading 
Comp. 


Arithmetic 
Concepts 


Arithmetic 
Appl, 


Study Skills 
References 


Study Skills 
Graphics 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Exp. X 
n «= 29 S 


568.4 
88.6 


617.2 
04.7 


558.3 
95.8 


56^7 
76.8 


543.9 
79.4 


572.0 
87.0 


554.6 
105.6 


578.1 
118,1 


606.9 
180.1 


616.5 
91.8 


Ret. Srs. TL 
n « 10 ' S 


599.2 
132.3 


626.0 
92.6 


581.5 
97.8 


610 8 
94.1 


568,8 
95.9 


563.3 
117.6 


600.6 
123,1 


602.0 
93.4 


605.0 
110.6 


606.9 
128.7 


Presel. X 
n - 12 S 


B66.5 
74.5 


697,8 
53.5 


651.2 
95,4 


676.0 
87.4 


666.6 
90.9 


677.6 
78.8 


676.2 
76.4 


706.6 
89,3 


'696.2 
88,5 


735.1 
77.4 


« Tot. (CE)2 7C 
n « 52 S 


597,5 
102.0 


637.9 
91,3 


584.7 

101. a 


600,5 
93.1 


577.7 
97.9 


595.2 
101.2 


592,2 
113.1 


613.0 
118.2 


627,5 
109.3 


642,5 
108.3 


Control TC 
n « 12 S 


531.4 
112.0 


570.0 
102.9 


526.9 

77.^ 


;541.8 
76.5 


532.1 
56.7 


565.9 
72.9 




533.2 
114.3 




566.3 
90,5 



* In this and future tables the letters n^ X and S are used. JThe lettef 
\ n represents the number of students in a particular group, X represents 
] the mean (or average score for the group) and S xeprMents the standard 
deviation {a measure of group disr^xSion such that two-thirds of the 
group will appear within the range of one standard deviation above or 
below the mean) . 



A multivariate analysis of covariance (MANCOVA) was run on ^he pre- and 
posttsst scores of the total (CE>2 population. A MANCOVA tabLb is 
included in Appendix B (CTBS #2). 

It can be inferred frc»n the analysis that (CE)2 students made statistically 
significant gains in Jasic Skills, especially in reading comprehens/on. 



'They also made marginally significant gains* in arithmetic concepts and 
arithmetic applications; but when conditioned for reading comprehension, 
^the^e significant gains disappear. Apparently, the arithmetic subtests 
contain a large general intelligence or reading comprehension component. 
No significant changes were noted in the study skills subtests. Conversion 
of the expanded standard scores to grade equivalent scores indicates that 
during the appromixat^ly 6 months between pretest and posttest, (CE)2 students 
gained 18 months in reading comprehension, 6 months in arithmetic concepts, 
5 'months in arithmetic applications, 7 months in study skills reference and 
12 months in study skills graphics. ^ 

Pre- and post-(CE)2 scorps on the reading and arithmetic subtests 

were also analyzed to determine the varicibility of change scdres among 
{CE)2 students. To answer the question of how man^ students made negative 
change, no change, or positive change^, a frequency disttibution of ^ * 

change scores was constructed (see Table 9). The"distribUtion was fairly 
normal, with the median slightly above zero. A considerable number of 
students made negative changer — changes probably more indicative of test 
taking attitude than actual change in Basifc Skills ability. 



. TabO^e 9 

DI STRI BUTION Of CHANGE S ON 
(CE)2 CTBS SCORES IN FY 75 





CTBS Subtest 


Score Chang 3 


Heading 
Compreherision 


Arithmetic 
Concepts 


Arithmetic 
Applications 


-150 to -100 


0** 


0 


2 


- 99 to - 50 


3 


5 


3 


- 49 to 0 


12 ^ r 


IS 


17 


+ 1 to 50 


^ \ 




13 


+ 51 to 100 


17 \ 


12 


15 


+101 to 150 


5 


2 


2 


+151 to 200 


1 


0 


0 


Over 200 


1 \ 


0 \ 


0 



Numbers refer to the number of (CE)2 stuidents demonstrating a given 
xange of changes in CTBS scores stated \ijn expanded standard score units. 



A multivariat analysis of covariance (Appeipdij^ B, CTBS #.1) using the 
pretest as the covariate and comparing t experimental group with the 
control group indicates no significant dif£irencc?s in the adjusted m^an 
posttest scores. This supports the hypothes\|.i? that (CE)2 students would 
not gain less than comparcUDle students in tjh^ high school. 



Throughout this Report the term "marginally significant" will be used 
to denote an effect with a probability level such that .05<p<.10. 
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These results from the Basic Skills assessment tend to- support both the 
hypothesis that (CE)2 students would make gains in Basic Skills and the 
hypothesis that the control group would not gain more. This is an 
encouraging if ^not iirpressive result, especially considering the fact 
that \^E)2 is not a concentrated Bas^ic Skills program. 

A multivariate anajysis of covarianc^e of (CE)2 student scores (see 
Appendix B, C'T'PS #4) compared gains jnade by the three student groups withm 
(CE)2: the experimental group, returning seniors and the preselected 
group. There were no significant differences between the groups. 

Psychosocial Maturity^ Scale 

The Psychosocial Maturity Scale (PSM) was adminstered to all (CB)2 students 
in the fall and again in the spring. The work, self-reliance and identity 
scales only were adminstered to. the control group in the fall (due to 
time constraints) and the entire instrument was administered to the control 
group in the spring. The purpose of the instrument was to assess students' 
self -perceptions on a range of variables related to individual adequacy 
and social adequacy and to see if change in these self-perceptions took 
place . 

Means and standard deviations on the pre- and posttest of the PSM are 
displayed in Table 10. 



Table 10 



SUMMARY OF THE PSM PATA FOR 
(CE) 2 AND THE CONTROL GROUP 



^^'-^^^^^ Group , 
Score 


Exp. 
n = 29 


Ret. Sr. 
n = 10 


Pre. Sel. 
n = 12 


Total (CE)2 
n = 51 


Control 
n = 8 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


IRost 


work 


29.1 
4.7 


24.8 
5.4 


27.8 
7.1 


27.0 
4.6 


30.4 
3.9 


27.6 
5.7 


29.2 
. 5.0 


25.9 
5.4 


28.0 
3.4 


2)3.0 

4:nP 


Self- ; 3? 
Reliance S 


30.7 
5.0 


29.9 
5.7 


28.4 
5.1 


32.0 
2.8 


33.8 
3.7 


32.8 
4.7 


31.0 
5.0 


31.1 
5.1 


29.5, 
6.9 


30.^ 
4.7 


x 

Identity ^ 


29.6 
5.2 


27.1 
7.2 


26.6 
5.6 . 


31.0 
5.1 


32.2 
4.9 


29.4 
6.5 


29.6 
5.4 


28.4 
6.8 


28.9 
5.7 


29.0 
5.5 


3f 

Communicate 

S 


26.9 
6.4 


26.7 
5.5 


24.3 
6.1 


29.1 
5.3 


26.7 
4.7 


27.2 
4.6 


26.3 
5.9 


27.3 
5.3 




26.8 
4.8 


Role g 


32.3 
3.8 


31.2 
4.4 


'31.5 
4.3 


33.3 
3.7 


33.8 
3.7 


34.8 
3.0 


32,5 
3.9 


32.5 
4.2 




31.8 
5.4 


Trust g 


28.2 
5.0 


2^.8 
5.0 


26.7 
3.7 


29.3 
3.8 


30.9 
4.0 


31.6 
3.6 


28.6 
4.7 


30.1 
4.5 




26.8 
4.1 


Social X 
C^ommitment S 


33.4 
5.1 


32.4 

5.:. 


35.7 
4.1 


35.6 


37.1 
4.1 


35.7 
4.4 


34.7 
4.9 


33.8 
5.0 




30.9 
4.1 


Change ^ 


35.7 
4.2 


35.3 
4.3 


37.4 
5.9 


36.1 
5.8 


39.8 
3.6 


37.8 
3.3 


37.0 
4.7 


36.1 
4.7 




33.0 
6.2 


\ Social X 
b^sir. S 


21.1 
3.5 


19.6 
3.5 


22.1 
4.2 


21.8 
2.0 


20.4 
2.9 


19.2 
3.4 


21.1 
3.5 


19.9 
3.3 




20.9 
2.7 



\ 
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A multivariate ctrifiiysis of covariance run on the pre- and posttest scores 
of the total (CE)2 population is summarized in Appendix B (PSM #2), While 
an examination of group means indicated very small changes in scores from 
pre- to posttest the multivariate test indicated a significant change 
in overall PSM scoies. This effect was due prijnarily to growth on the 
change and trust scales. 

A multivariate analysis of ccvariance was run using pretest scores as 
covariates and comparing the adjusted posttest means on the work , 
s If-reiiance and identity scales for experimental and control students 
(see Appendix 3, PSM #1). The analysis indicated that the experimental 
group score cn the work scale declined significantly over the course of 
the year in comparison to the control group score on the saune scale. 

The possible explanation for the significant decline in score on the work 
s^alc is that (CE)2 students, exposed to the everyday experience of work 
(including the routine and the f^esponsibility) developed a more realistic 
though less positive attitude toward work. An honest response to certain 
items on the work scale (e.g., "I often get behind in my work") for many 
kCB)2 students who were in fact behind in completing program expectations 
would also tend to lowpr the posttest score. 

The ten items comprising the work scale together with the pprcentage of 
(CE)2 experimental group and control group- students disagreeing with each 
item at the beginning and end of the school year are displayed in Table 11. 
The (CE)^ students had "less positive" attitudes toward nine of the ten 
items at the end of the year while the control group had "more positive" 
attitudes on seven of the ten items based upon the scoring key of the test 
authors. Further discussion of these findings appears on page 138 of this 
report. s ^ 

(CE)2 pretest scores on the PSM tended to be quite high. Scores on 
eight of the nine scales were higher at pretest time this year than they 
were at the posttest of FY 74. Thus regression toward the mean may have 
influenced pre-post change on all scales cuid tempered any indications of 
upward growth. Correlations were run between the sex of: (CE)2 students 
and their scores on each of the PSM scales. No significant differences 
were found between boys and girls except on the role scale (r=«.37, , 
p<.01, dF=38) and social commitment scale (r=.33, p<.02, dF=38) where girls 
outscored boys. 

A comparison of the three (CE)2 subgroups on the PSM using MANCOVA revealed 
no significant trends among the groups (see Appendix B, PSM #3) . 
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Table 11 



PERCENT OF (CE ) 2 EXPERIMENTAL GROUP 
STUDENTS WHO DISAGREED WITH BACH ITEM 



AND CONTROL GROUP 
ON THE PSM WORK SCALE* 



icexn 




Pre 


JrvJS I. 




V^-Cj / 2 \** -'^f 




46 


sup^A^seu T.\j ao • 


Pnnt-r-nl * ^nss 1 9\ 




87 


ic s more xnipci. cajiu ror a jod co 




Q9 


77 


pay we XX cnan rOx Xu uO pe 


concrox 


67 


7S 


Interesting* 








X De xx6ve xn wox Kxnw) onxy as naxu 


ICJCi/ 2 


07 


53 




Con t" r 0 1 

V«X VX 


75 


87 


1 leave my nomewQrK unrinisneQ xr 


iur ; 2 


^7 




unexe axe xous ^(x^u iv snows 


Con'L^ol 




7^ 


on that evenxng. 








X uv^n u v^xucn ^ 1.14x011 uxic wwx Jv x 




63 


40 


Suax u • 


V<^It L.X wX' 


62 


62 


X oxuen ucnci llkjui \Jiixi uiixn^ 




63 


40 


4-0 ^not'H^r" h^For"^ f iniQliiTici snv 
OkIi^uiicx ijcx^xc xxiixotixi'^ any 


Print- T0 1 

UX WX 


62 


75 


one of them* 








I often get behind in my work. 


(CE)2 


57 


29 




Control 


37 


37 


I hate to admit it, but I give 


(CE)2 


66 


46 


up on my work when things go 


Control 


75 


87 


wrong. 








I find it hard to stick to 


(CE)2 


74 


46 


anything . 


Control 


62 


50 


When a job turns out to be much 


(CE)2 


86 


86 


^ harder than I was told it would 


Control 


75 


57 


be, I don't feel I have to do it 








perfectly. 









Percentages shown are a combination of students who disagreed or strongly 
disagreed wxth each xtem. The test authors consider the "best*^ resoonsp 
to each item to be that of disagreeing with the statement. 



Semantic Differential , 

A semantic differential type of instrument was administered to all (CE)2 
students on a pre-post basis* Only the me, adults , scho ol, 
learning and work scales were administered to the control group x 
students in the fall to conserve testing time and the total instrument was 
administered to the control group in the spring. The purpose of the 
instrument was to assess chauiges in student attitude toward themselves and 
toward selected concepts related to learning and the world of work. 

Means and standard. deviations for the pretest and posttest are displayed 
in Table 12. 
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iKini.T^ ANL lUhTFLM Mir.ANS AND STANDARij DLVIATIONS OK iHt 
(ih)^ t\Hb^ L-'NTKUL LiHiMif ViN THE SLMANTIC DIFFERENTIAL IN5TRUMLf4T 





.J i 










Kos. 










J ^' 

■) 




i'" / 








" J ♦ 












_ J. 7_ 


1 , t, 




t . 


r 


A 






• 






4 


n-i ) 






1 % 






K • 


' 


i 




^' 1 


X 


7 












'1= i i 
















l_ 




T(.7t'. 


X 




'i' 




') 1 . J 






n - >(j 




b 


J 


i 










-t 


X 












iij; i 

















Aciu 



r. I 




A multivariate cuialysis of covariance was run on the pre- and posttest 
scores of the total (CE)2 group. A summary of the analysis is displayed 
in Appendix B (SD #2). 

The multivariate F test indicated a positive significant change in (CE)2 
student attitude as' measured by thig^instrument , All of the concepts 
^^xcept for "decision making" showed |^ignif icant growth. As with the 
Psychosocial Maturity Scale T attitudte toward the concept of "work" 
declined significantly over the course of the year, but when conditioned 
for the effects of the other scales (except "decision making"), this 
significant effect disappears and is thus not a unique effect. 

MANCOVA analysis of experimental and control group data (Appendix B, 

SD #1) indicated no significant differences in change scores between those 

two groups on the semantic differential. 

Self Directed Search 

The Self Directed Search (SDS) was administered to all students in (C^)2» 
the control group and students in the Diversified Occupations class of 
the Cooperative Work Experience (CWE) program in the fall and again in the 
spring. 

Pretest and posttest means and standard deviations are displfved in 
Table 13. A brief description of the six career and, personality styles 
(i.e., realistic, investigative, etc.) is contained in Appendix C. 
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Table 13 . 

PRETEST AND POSTTEST MEANS AND STANDARD D^IATIONS 
OF THE (CE) 2 / CONTROL AND CO(»>ERATIVE WORK EXPERIENCE PROGRAM 
STUDENTS W THE SELF DIRECTED SEARCH 







Realistic 


Invest. 


Ai^tistic 


^ Social 


Enter . 


Convent . 


Differ. 


Consist . 






Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Exp. 


X 


6.9 


7:5 


5.2 


5.9 


8.2 


7.8 




9.9 


6.1 


5.9 


3.7 


4.5 


5.5 


5.3 


2.5 


2.3 


n»30 


s 


4.7 


4.9 


3.7 


3.5 


3.2 


3.1 


3.7 


2.9 


2.8 


2.9 


2.9 ' 


2.8 


2.8 


3.1 


.68 


.'64 


Ret. Srs. 


X 


9.0 


9.3 


6.2 


6.9 


6.9 


b 6 


10.0 


9.8 


5.9 


7.0 


6.4 


5.6 


5.5 


4.4 


2.2 


2.4 


n=»10 


s 


5.1 


3.8 


2.9 


3.7 


5.0 


3.7 


2.9 


3.7 


5.0 


3.7 


2.5 


3.3 




2.5 


1.9 


.92 


.84 


Pre. Sel. 


X 


5.8 


5.8 


5.9 


7.0 


6.8 


6.8 


10.7 


10.7 


5.0 


5.3 


4.3 


3.6 


6.8 


6.0 


2.8 


2.8 


n-12 


s 


4.5 


4.9 


3.5 


2.1 


3.1 


2.8 


3.6 


3.8 


2.6 


3.2 


2.6 


2.4 


1.6 


2.7 


.62 


.39 


Total ^CE)2X 


7.0 


7.5 


b.6 


6.3 


7.6 


7,3 


10.0 


10.1 


5.8 


. 5.9 


4.4 


4.5 


5.8 


5.3 


2.5 


2.4 


n«:S2 


X 


4.7 


4.8 


3.5 


3.2 


3.6 


3.1 


3.5 


3.2 


2.7 


3.1 


2.9 


2.9 


2.6 


2.8 


.72 


.67 


Control 


X 


8.2 


8.7 • 


4.0 


3.9 


7.0 


6.6 


10.9 


9.8 


6.3 


6.9 


4.8 


5.6 


5.6 


6.0 


2.0 


2.3 


n«12 


s 


5.2 


6.1 


2.1 


2.7 


3.7 


3.6 


2.6 


3.5 


3.4 


3.5 


3.7 


3.6 


1.8 


2.5 


.95 


.78 


CWE 


X 


7.9 


8.6 


5.8 


5.2 


6.4 


7.4 


10.1 


8.8 


5.4 


5.3 


5.0 


4.4 


5.9 


6.6 


2.3 


2.4 


n-16 


s 


5.0 


4.4 


3.9 


4.4 


3.4 


4.2 


3.1 


3.5 


3.3 


3.6 


4.3 


3.9 


2.6 


2.4 


.85 


.73 
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A multivariate analysis of covariance on (CE)2 iDS data indicates no 
significant change in scpres over the course o*: the year (see Appendix 
SDS #4). ♦ 



Multivariate analysis of covariance revealed no significant dif f eroii'-e' in 
adjusted posttest means between experimental and control grotipc 
(Appendix B, SDS #1). A second analysis of covariance, comparing (CF)o 
experimental students and CIJW SDS results indicates that (CE)2 students 
increased their investigative and social scores to a significantly greater 
extent than did the CWE students (Appendix B, SDS^ #2). No definite 
conclusions can be drawn from these data. 'Both the differentiation anci 
consistency scores remained very stable over the course of the year for 
all groups./ Changes in scores on the six careeVpersonality areas 
(realistic, investigative, ' etc. ) also were not significant except for th^ 
increase in r^listic. This was probably influenced by the fact that 
many students did explorations in career areas that could be labeled 
within the category of realistic. 

r 

The extent to which students' projected careers. were congruent with their 
SDS code was computed using the two preferred careers cited by students 
in the End of Year Questionnaire and their SDS codes. Student careers 
were classified into Holland's six categories (realistic, investigative, 
artistic, social, enterprising and conventional) using The Occupations 
Finder as a guide.* If the classification of the career matched the 
student* s primary (first) SDS code, a congruency code of "3" was assigned. 
If the classification of the career matched the secondary or tertiary code«, 
a congruency code of *'2" or "1" was assigned respectively. If the 
classification did not match the SDS code at all, a "0** was assigned. 

c 

A percentage distribution of (CE)2 and control group SDS congruency codes for 
the two careers selected at tY fend of the year is displayed in Table 15. 

Table 14* 



PERCENTAGE DISTRIBUTION OF SDS CONGRUENCY CODES 
^ FOR (CE)^ AND CONTROL GROUP STUDENTS 



Group 


First Occupational 
Choice 


Second Occupational 
Choice 


0 


1 


2 


3 


0 


1 


2 


3 


Experimental (n»30) 


17** 


3 


28 


52 


4 


18 


21 


57 


Preselected (n=12) 


17 


17 


8 


58 


27 






46 


Returning Srs. (n=10) 


10 


30 


20 


40 


33 


17 


' 17 


. 33 


Control (n-12) 


0 


29 


14 


57 


13 


13 


13 


61 



** Percent of students 



Consulting Psychologist Press, .(c) 1972, revised 1974. 
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Eighty-three percent of the experimental student^* first career choices 

and 96 percent of their second choices matched (to some degree) their, SDS 

codes. One-hundred percent of the control cfroup students* first choices 

and 87 percent of theiir second l^Jioices matched their SDS codes. Because 

the congruency code distributions were so similar for these two groups, 

no inferential, statistics were computed and it was concluded that no 

significant differences existed between the congruency of experimental 

and control group ccureer choices. 
■ 

Nearly one-third of the preselected and returning seniors^' second <:areer 
choices did not match their SDS codes; It shquld be noted, however, that 
Holland's syst^ of classifying careers \itilizes the full three letter 
SDS code while ou^ method of conqputing the congruency . code utilized only 
one SDS code at a time. An examination«of the (CE)2 **0" congruency 
scores reveals that many of them would have been higher if a more 
sophisticated matching syst^ utilizing the full three letter code for 
occupations had been used as well as the actual strength of the students* 
score in each area rather than merely the rank order. 

During the coming year, additional scoring systems will be investigated 
and a better alternative developed to that employed this year. 

Staff feting of Students 

Two (CE)2 staff members who have continuous contact with (CE)2 students 
(the learning manager and student coordinator) were asK'jd during the 
first semester to rate on seven scales of behavior each (CE)2 student as 
he/she appeared during the first three weeks of the programii These 
staff mendsers were again asked to rate the same students at the end of the 
program year. The purpose of these ratings wa^ to document staff members* 
perceptions of individual student change over the course of the year. A 
summary of the ratings is displayed in Table 15. 
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A multivariate analysis of covariance run on the pre-post data iridicated 
significant positive ^owth on this instrument on the multivariate test and 
on each pcale (except the converse with adults scale) on the univariate F test 
(see Appendix B, Staff Ratings #1), The step-down F tests, however, indicate 
a high degree of correlation between the first six scales. 

The interpretation of these staff ratings should be tempered by the fact 
that the interrated reliability for this instrument is only nioderate (see 
Appendix C) • 

0 - 

gtu<lent End of ^^ar Questionnaire 

A student questionnaire was administered to all (CE)2 and control group 
students in the spring.' The purpose the instrument was to obtain end 
of year data on certain questions asked of the, same students at the 
beginning of the year, to assess student knowledge of job trends and 
r-lated information, and to collect data on student reflections about 
their scho6l/ (CE) 2* experiences. A tabluation of responses to the 
questionnaire is displayed in Appendix D. 

In response'' to 'a question on future plans, 27 percent pf the (CE)2 students 
reported plans t» be working full-time one year after high school, in 
conjunction with furthering their education, 20 percent of the ftudents 
expect to be working part-time. „ 

Most-of the (CE)2 students (76 percent) plan to continUe' their formal 
education beyond high school. Twenty percent of them plan to graduate 
from a foui-year institution while another 10 percent plan to go to a 
graduate or professional .school beyond college. 

In comparing the responses of the (CE) 2 experimental group with the 
responses of the control group,* significantly more control group students 
(Chi-square=6.28, p<.01, dF=l) plan to enter an apprenticeship program. No 
significant differences were found in other future vocational plans or 
in educational plans. * 

Fifty-one percent of the (CE)2 students reported being interested in 
professional, administrative, or proprietary careers as T:he first 
occupational choice. Eight percent were interested in semiskilled jobs and 
no students were interested in unskilled jobs. No significant differences 
were found m the level of career choices of the experimental and control 
groups. 

Two- thirds of the (CE)2 students reported that they had worked and/or 
observed at both jobs listed as career choices. Only one student reported 
i^vmg neither worked or observed at the careers he/she was interested in. 
Significantly more (Chi-square=8. 28, p<.04, dF=3) of the experimental 
students reported work and observation in the careers of their choice than 
did control students. 
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* -The responses of the total (CE)2 group were not compared to those of 
the control group because these students are not representative of the 
same population. 
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Eight percent of the (CE)2 students reported that they did not know the 
steps necessary to prepare for and f.nter each of the two jobs, but 87 
percent felt they would be able to complete the necessary steps for 
preparation and entry into at least one of the jobs. Significantly more 
experimental students than control students felt they would be dtle to 
complete the necessary steps for job entry (Chi-square=6. 28, p<.C/4, 
dF=2). No differences between experimental and control groups were 
observed in the^ sources of information used to choose between potential 
careers nor wer^ there differences in the proportions of students able 
to list jobs th^t they had ruled out as career choices during the year. 

(CE)2 students rated the program high in helping them attain the program 
goals. Average ratings were from 3.27 to 4.47 on a five-point jcale. 
The goal area in which they reported the progreun least effective was, in 
the improvement of reading skills. This student rating is in sharp 
contrast to the CTBS evidence of dramatic growth in reading achievement. 
Students rated the program highest in helping them learn what to look at 
in considering a job, ^ 

Control group students were asked to rate the regular high school program 
on the same dimensions.^ The experimental group gave (CE)2 significantly 
higher ratings on 14 of the 21 goals- No significant differences Were 
found in the other seven ratings, although all differences except. one 
were in favor of (CE)2 \(see Appendix D) . 

Students wer^ asked a series of ten questions dealing with' job trends and 
career knowledge. The (CEX^ experimental group significantly outperformed 
the control students on the group of ten items {multivariate F=3.21, 
p<.006, dF=10 and 33). This difference was p'rimcurily due to two items. 
Significantly fewer (CE)2 students agreed with the statement "Most persons 
remain on the same job throughout their adult life" and significantly more 
agreed with the statement '/The State Employment Service Office provides 
free information about job openings and jo^ trainiri^ programs." On a 
marginally significant it^m, more' (CE) 2 stuaents agreed with the statement 
"Le6s than one-third of all job openings require a collegife degree." 

/' 

Marginal significant differences were found favoring the experimental 
group over the control group in reading habits (multivariate F=1.96, 
p<.093, dF=8 and 26). These differences were due mainly to increases in 
the amount of reading of pcunphlets and newspapers. Experimental students 
also reported significantly more use of public resources^muitivariate 
F=2, p<.086, dF=6 and ,^7) , especially libraries and attendance at public 
meetings. 

(CE)2 students gave the program a very high overall rating (4.40 on a 
five-point scale) with the experimental group rating (CE)2 significantly 
higher (Chi-square=19.62, p<.001, dF=3) than the control group rated the 
\ regular high school. One (CE)2 student reported that he/she would not 
^> enter (CE)2 if he/she had it to do over again but 87 percent were "sure" 
W "very sure" that they would enter the program again. 

\ 

Cc^n^aring (CE) 2 ^to the regular high school program 96 percent of the " ' 
students reported that (CB)2 provided more opportunity to learn about 
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occupations and 70 percent reported that it provided more dpportunity for 
general learning. Ninety percent of th^. (C2)2 students reported that they 
were more motivated to learn in ICE) 2 than in the regular high school. 

When asked what they perceived -to be the greatest strengths of the {CE) 2 
program, 33 percent of ICE) 2 students identified the opportunit^s for 
"hands-on" learning, 33 percent identified the empath(»tio and helj^ful 
staff, and the rest mentioned a variety of things "including the opf;>^ortunity 
to learn ^)3out careers and the freedom and responsibility given students. 

The most commonly mentioned weakness of the program (mentioned by 15 percent 
of the students) involved difficulty or inconvenience in securing a 
desired employer site. Other problems mentifc>ned included transportation 
problems (6 percent) and too much work (6 percent) . 

Staff Questionnaire 

An end of year -questft-onnaire was. administered to^the staff of the ICE) 2 
program. The questionnaire asked^ staff, members to rate the importance 
ahd effectiveness of 14 leafning strategies employed in (CE)2- The staff 
members were also asked to irate the extent to which (CE}2 helped students 
attain the FY 75 student outcome goals. Then, on -a more general level, 
staff members were asked, to identif^^ the major facjtors that contributed to 
the success of (CE)2 and those that limited (CE)2's success. They 'were 
asked to identify-^e areas of greatest and least student growth, and to 
predict how a (CE)2 gradxxate would differ four years in the future from 
his/her peer who graduated from the re^aiar high school program. 

six of the seven staff members responded to the anonymous questionnaire. 
A copy of the questionnaire with the 'tabulated responses is included in 
Appendix F. > 

Staff members were aske4 to rate the importance and effectiveness of 14 
(CE)2 learning strategies. These include: student orientation, the 
Student Accountability System, student negotiation, preprepared projects, 
individual projects, journals, competencies. Exploration Packages, 
learning level process, special placement, ILA Basic Skills, materials, 
employer semirtars, student retreat and group activities. 

Although all the (CE)2 learning s\:rategies were rated inqportant (rated 
three or greater on a five-point scale), the staff rated the Student 
^ccountcUDility System, the student negotiation process, individual projects 
and the learning level process as the foUr most inqportant learning 
strategies. Group activities and en^loyer seminars were rated as the 
l east important strategi.es in the (CE)2 learning procfram. 

The rpst effective leatning strategy based on (CE)2 staff ratings was the 
Sttidi^t Accountability System.- The student negotiation process, individual 
projects, the journals and the con5)etencies shared ratings as the second 
most effective learning strategies. The strategies rated least effective 
were grpup activities, employer , seminars and student orientation. 



^taff members cated program attainment of outcome goals high on a 
five-point scale. The -ange^of ratings went from 3.5 to 5.0 with most 
ratings distributed jcldse to 4.0. 

The .CCE)2 protfram ha^s been most successful in "helping students to 
communicate cdTnfortably with adults" according to the staff ratings of 
outcome attainment. * Three program outcomes that shared the second 
highest rating by the staff >&ei:e: 

"... students. . .understand more about themselves." 

"..'.students. . .become acquainted with a broad range of resources to 
use in gathering information for work and decision Ti?^kinq." 

"... students. . .take responsibility for their own action." 

The four student outcomes rated as least attained were: 

".. .students. . .understand the role of science in our society today." 

"... students. . .understand the democratic process." ^ 

".. .students. . .develop their own creativity." 

"... students. . . inprove their rea^Jing skills. " 

The one factor mentioned mpst often on an open-ended question by staff 
members as contributing in a major way to the success of the (CE)^ 
program this past year was th^ improved compatibility of the staff itself, 
and its ability to work together consistently. There was no consensus 
on what factors limited the success of the programi^ although uncertainty 
about the future direction of the funding agency (NIE) was mentioned by 
two staff members as aj constraint. 

i 

Career awareness was mentioned most often as the area in which students 
made greatest growth. Basic Skills, especially reading, were mentioned 
as an area where least growth was perceived. 

Many outcomes were mentioned as the ones that would differentiate this 
year's (CE)2 graduate from this year.'s regular high school graduate in 
four years. Most .prominent ainong these outcomes was an "undpr standing 
of career options" and "satis-f action with career." (CE)2 graduates 
shoul4, according' to the staff, also be more able to communicate with 
adults and utilize their community as a resource. 

Student Hifyear Interview Summary 

In early January 1975, a se'mistructured interview was conducted by the 
internal evaluation staff with 20 randomly selefited (CE)2 students. 
The purpose of the interview was to assess student perceptions of processes 
and activities that could not be easily assessed by questionnaires or some 
other means. 
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Topics covered in the interview included: 



1 

1 * 
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2, 


Student 


freedom in carrying out learning activities 


3. 


Student 


evaluation of their own learning activities 


4. 


Student 


career awareness 


5. 


Student 


progress 


6. 


Program 


s effect on students 



. A ^opy of the interview schedule with tabulated responses is included in 
Appendix E. 

One student, because of a time conflict was unable to complete the 
interview, tor this reason, questions one and two represent the responses 
of^ 20 students and questions three chrough nine, the responses Of 19 
students. 

tMost (CE)2 students felt, they had a high level of involvement in the 

planning of their learning program. On a scale ranging from "no 

involvement" to "much involvement," 20 percent of the students sampled 

said they were somewhat involved in the planning process and 80 percent 

said they were very much involved. \ 

» 

On ,a more specific level, students felt they were very involved in planning 
their individual projects. The most co'tiroon procedure described started 
with the student taking an idea for a project *"o the learning manager 
(LM) . They discussed it and the LM asked the student to think about it 
for a few days and write down ideas about appropriate learning ^qtivities. 
The LM then reserved the right to alter these activities oi add t^ them 
and to write them up o i the project form: Ninety percent of the students 
•sampled indicated that they usually came up with the topic .themselves and 
took their ideas to the LM and eighty-five percent generatec? a list of 
activities that they felt would be appropriate. 

*Lo«s involvement was indicated in the planning of the preprepared projects. 
Sixty percent of the students indicated that they bave negotiated //ich 



instead of written summary, one student taped his comments. Another road 
a book and discussed it with the LM in place of an activity he did fiot 
rind paiLioularly relevcuit. Other students (40 percent) reported no 
involvement in the planning of the preprepared projects. They just 
worked through it as it was written. / 



Another area where students reported having input into the planning of 
their program was in the selection of employer sites for exploration and 
learning level work, seventh, -five percent of the sample indicated that 
they were generally able to get the employer sitea they asked for. One 
student remarked that two sites were recruited especially for him. Most 
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of the problems indicated by students n0t. able to get the job sites they / 
wanted involved either waiting until another student finished at the 
site in question (15 percent) or the ^iiiiited availability of some site, 
especially learning levels such as colot photography studios, airplane 
pilot programs and art studios (10 percent). 



\ 



Most students reported a greav deal of flexibility in how they carried 
out their projects, (Eighty percent indicated '^mach" freedom, 20 percent 
indicated "some".) Fewer felt this flexibility in work at employer sites. 
Twenty- five percent of the students felt they had a Iqt of freedom in 
doing things at the employer sites. Sijjcty-five percent felt they had 
"some" freedom and 10 percent felt theyjhad "little," For most students, 
company and union regulations, production schedules and lack df skills 
or knowledge on their part tended to l^ikit somewhat their activities. 
It should be pointed out at this point that 70 percent of the students 
sampled at that time had not ye^ had an opportunity to work on a learning 
level experience where student involvement would conijeivably /be much 
greater. 



nee 



the competencies students 



In demonstrating and being certified in 

reported the least amount of flexibility. Twenty percent i^ndicated 
"some" freedom, mostly in terms of when they could be certified on any 
given competency. Two students indicated that some option/s existed as 
to how subparts of certain competencies could be completec^. Fifty-fivo 
percent of the students felt they had "a little" flexibility and 20 
percent felt they had none, ^ ' 1 

Much variation existed in student opportunity or student iise of 
opportunities to evaluate their own work in (CE)2-. Thirty-seven percent 
indicated that they Viad "some" or "muchf opportunity to evaluate what 
they acconplished in the program. They: pointed tp the "Project Wrap-Up" 
activity which was optional on each project, informal diScussions about 
projects with the LM and requests for feedback by employer instructors. 
Sixty-three percent of the students fel| little or no involvement in ' 
evaluation processes. Th , typical response from these students w^s "I 
turn in the work. If they like it— fines. If they don't, t^hey tell me 
to do it over. " 



Most students (95 percent) indicated that they had thought sWiously 
about their future careef'r and educa*"ional plans after they en\tered (CE)2' 
While this thinking anl|a the experiences in (CE)2 have opened r\evr 
horizons about possibl^ careers, they haye also helped stiKJentte decide 
in which careers they Would not want to Work. Nearly 80 percent of the 
students were able to list specific jobs pr fields of work thatV as a 
result of experiences in (CE)2 (usually explorations) they were\ 
definitely not interested in. A rich variety of reasons were giyen as 
to why these jobs no longer seemed appropij-iaie. Some are listed \hero. 

' 1 

"Pdi cce work requires an authoritarian-type person." 

"I wouldn't be challenged by secretarial work." 

"It's Very difficult to always be encouraging in the retirement 
home , " 1 , 
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"I can't stand the constat activity of a day care center." 

"It takes too much educatiorixto be a lawyer." 

"Assembly line work is very routine — you don't learn much." 

"Working in a loud machine shop might damage my hearinq." 

"I didn't know secretaries did that much typing," 

According to the responses during the interviews, (CE)2 experiences have 
helped most students (95 percent) identify careers that they would like to 
find out more about and tiave helped^63 percent decide on careors that they 
would be interested in following although very few had made specific career 
plans by January. Eighty-two percent of those students interested in 
specific careers were able to identify specific things about themselves 
(mostly interests) that suited them for that type of career. All but one 
student traced their heightened interest in a given career area to specific 
exploration level experiences. The one exception was a student interested 
in public relations work for which he had not yet done an exploration. 
He felt, however, from general experiences both in and outside of (CE)2 . 
that this type of work would appeal to nim, ' 

Although over half the students sampled (68 percent) reported being 
* behind in completing projects and 53 percent were behind schedule in 
getting competencies certified, 74 percent felt that the number of 
projects and competencies expected by the (CE) 2 staff was reasonable. 
Two students o felt there were too many projects, two tho*?ght there were 
too many competencies and one felt there were too many of both. The chief 
complaint about the competencies, expressed by several students,^ dealt ' 
with the mechanics of competency certification, ' They reported that it 
was a very timfe consuming process, and, after the first few times, its 
cost (in terms of time and energy) outweighed its"^ merits. - 

The principle reason offered by students for being behind in their work 
centered around their procrastination and their "just not^ getting star Led," 
Two students expressed misunderstanding about the program expectations, 
two had difficulty in locating the resources they needed and one explained 
that his schedule and preferred way of doing things didn't coincide with 
staff expectations. In his way of thinking, he said, he was not brhin.i. 
In spite of being behind schedule, 89 percent of the students thought it f 
highly likely that they would complete all expected activities by the 
end of the year. Eleven percent were uncertain. 

Nearly three quarters of the students interviewed (74 percent) felt that 
the Program Year Action Zone system was a useful adjunct^in planning their 
learning activities. Although some tudents were no longer using the 
system because they were far ahead of program expectations, they and 
others felf the system provided motivation and good intermediate goals to 
work toward throughout the year. Eleven percent of the students felt 
the zone goals and activities were an extra burden and pressure which 
actually slowed them down. One other student reported not being affected 
at all by the system because of being an independent worker. 
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In resf)onse to an open-ended question about how the (CE)2 program affected 
the student^ 52 percent responded that it had helped them grow in 
responsibility and learning to take the' initiative in what they did. 
Twenty-one percent reported an increased ability to communicate and express 
feelings to others. Other program effedts mentioned included: 

"Helped me learn about careers." (3)* 

"Gave me more self-confidence." (2) 

"Helped me to look at things realistically." (1) 

"Helped me to get to know my community." (1) 

"Helped me do higher quality work." 

"Kept me in school." (1) 

"Gave me freedom to express myself." 

"Really helped me prepare for life." (1) 

No consensus was reached by students on how the (CE)2 program might be 
changed to be more useful for students. No more than two students ^ 
expressed the seune suggestions, indicating that no one particular problem 
was felt by many students. Suggestions included changing program 
requirements, adding staff members, cind allowing other school districts 
to try the program. 

Another question added to the interview* process after the first few 
students had already been interviewed asked students to estimate what 
proportion of their (CE)2 time was spent in the learning center rand what 
proportion was spent in the community. Estimate? for time spent in the 
community ranged from 25 percent to 65 percent with a mean of 45 percent. 
Students reported spending from 35 to 75 per ent of their time in the 
learning center with a mean estimate of 5^ percent. 

Little variation was expressed betwe'cri community and learning center 
activities in terms of student enjoyment or usefulness for learning. 
Half the students reported enjoying community activities more, 44 percent 
reported enjoying learning eerier activities more and 6 percent could not 
rate one above the other, ''a terms of learning, 43 percent folt they 
learned more in the community, 38 percent felt they learned more in the 
learning center and 19 percent could not decide. 

A final question, asked of only the last 13 of the 20 students interviewed, 
dealt with the student-staff retreat and student perceptions of its 
benefits. Forty-six percent of the students felt its primary usefulness 
was in helping them get to know others. Related to that, 31 percent felt 
it helped build a sense of community at (CE)o. Fifteen percent found the 



Number of students expressing each response. 
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problem-solving aspects of the student**staf f retreat most useful and 8 
percent of the students viewed it as a useful chanqe of pace. All comments 
cibout the retreat were extremely positive. 

Additional Student Findings 

Student Attendance Data . Student record? indicate that (CE)2 students 
were absent from the learning center an average of 9.1 days during the 
FY 75 program year. This figure is not substcintially different from th(?se 
same students' absentee rate while enrolled in Tigard High School prior to 
(CE)2f (8.1 days) nor from the absentee rate of a random scimple of Tiqard 
High students in the 1972-73 school year 110^.9 days). 

Student Use of Employer Sites . For the purposes of this analysis, 
"participating" employers means those employers ^jn the "active" list in 
April 1975. This designation applies to 95 employer sites. Shown in 
Table 16 are the number of participating employer sites in each of the 
main categories of the Standard Industrial Classification * system for 
1974 and 1975. The number of employers in each category is approximately 
the same for bbth years. 



Table 16 



PARTICIPATING (CE)2 EMPLOYER SITES 
CLASSIFIED BY THE 
STAI4DARD INDUSTRIAL CLASSIFICATION SYSTEM 



Classification 


1974 


1975 


No. of Sites 


No. of Sites 


Agriculture, Forestry and Fishing 


1 


2 


Construction 


3 


1 


Finance, Insurance and Real Estate 


2 


4 


Manu^facturing 


7 


9 


Mining 


0 


0 


Public Administration 


8 


7 


Retail Trade 


17 


16 


Services 


44 


50 


Transportation, Communications, 

. Electric, Gas and Sanitary Services 


5 


5 


Wholesale Trade 


0 


1 


Total 


s) 


95 



The explorations and learning level experiences that students partici[;aLed 
in in FY 75 were classified by the Occuj^a tional Outlook Handbook (OOH) 



♦ Standard Industrial Classification system classifies businesses by types. 
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classifications and are summarized in Table 17. (See Appendix I for a 
complete list of occupations explored by (CE)2 students.) 



Table 17 



NUMBER OF (CE)2 EXPLORATION AND LEARNING PLACEMENTS 
BY -^GeyPATIONAL 0[JTLOOK HANDBOOK CLASSIFICATION 



KAjn L-iassit icat icns 


Number of Site Placemt»nts 


Exploration 


Learninq 


1. Industrial Production and Related 
J Occupations 


20 


2 


2. Office Occupations 


40 


Q 

o 


3. Service Occupation- 


51 


10 


4. Education and Related Occupations 


33 


12 


5. Sales Occupations 


22 


3 


6. Construction Occupations 


6 


1 ^ 


7. Occupations in Transportation 
Activist ies / 


0 


f\ 


8. Scientific and TecJjge^cal Occupations 


30 


8 


^ Mechanics and Repairmen 


53 


12 


10. Health Occupations 


39 , 


6 


f 11. Social Scientists 


0 


0 


12. Social Service Occupations 


17 


5 


13. Art, Design and Communications 
Related Occupations 


57 


5 


14. Not Classified 


22 


8 


Total 


390 


82 



The total number of explorations in FY 75 (390) by (CE)2 students -is 
nearly double that of the previous year (201). This may be partly 
explained by the slightly larger student population (62 students this 
year versus 50 last year) and by the decline in numbers of "learning level 
experiences. Program requirements were? changed slightly in FY 75, making 
a given number of learning level hours no longer mandatory. As a result, 
82 learning levels were completed this year compared to 90 in FY 74. 

The proportion of experiences in each of the OOH categories has remained 
.^bout the same, with the largest number of experiences .n Office, Service, 
Education, Mechanical and Health occupations. 

Student Use of Tigard High School. Seven students wore involved in cours 
at Tigard High School (THS) this ynar. These courses were: algebra 
current events, French, chemistry, advanced theatre arts, scuba diving 
and emergency medical technology. - r. 

Five students were also involved in extracurricular activities at TigarH 
High School. These activities were football, wrestling, water polo manager 
swimming/water polo and volleyball. m addition, (CE)2 students used the 
lunchroom and library facilities. The number and types of uses' of the 
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high schcx)! this year compare favorably with those found in previous years. 

Re-enroll ment in Tigard Hi g h School . At the completion of their junior 
year in (CE)2, two students made the decision to return to Tigard High" 
School for their senior year. Below is a summary of two interviews 
conducted m June by a member of the NWREL evaluation unit with these two 
(CE)2 Duniors, whom we will call Charles and Larry, it was felt that 
additional insights might be gained about (CE)2 by interviewing the two 
students who have decided to return to the regular high school program to 
complete their senior year. 

Charles indicated four reasons for wanting to return to the regular high 
school program: to take some necessary courses, such as advanced- biology 
and algebra ll needed to prepare him for college and a future dental career; 
to play football and have a better ch^ce of obtaining a football 
scholarship; to participate in the social life at Tigard; and, to be able to 
rk for pay a half of each day after the football season. 

When he first learned about (CE)2 he felt it was a neat program and would 
be a good escape from the regular high school routine. At that time he ' 
was thinking of it as a two year experience. His parents first thought 
he was dropping out of school by getting into (CE)2 but later they became 
sold on the program. The personality of several of the (CE)2 staff> and 
the opportunity to work at various job sites were two of the main things 
that attracted Charles to (CE)2. 

As a result of being in (CEj 2 for the year, Charles felt that he has 
become more mature due largely to the fact that he was treated as an adult 
and left free to reach the expe^ctations of the program whereas at THS he ^ 
felt he had been treated like a kid. Charles' (CE)2 work experiences in 
his opinion, and his work with the denti helped to influcen his career 
choice of dentistry. 

Durinc; the year in (CE)2, Charles continued to play football at THS and 
wrestled for a month and a half. Toward the beginning of the year he 
used the THS library and lunch room a lot but this dropped off later in 
-he year. 

Charles would be willing to recommend (CE)2 to other students and has 
left open the option of returning to (CE)2 at the end of the next semester 
If the adjustment of returning to THS does not work well. He felt that 
one problem faced by a student in (CE)2 who returns after a year to 
regular high school may be the adjustment back into an environment where 
students are told exactly what to do rather than given the freedom 
available in (CE)2. For that reason, he felt it may be better for a 
student planning to spend only one year in (CE)2 to make that his senior 
rather than junior year. 

Larry spent his entire year as a junior in (CE)2. During this> time, he 
took an algebra class at THS and also explored emergency service careers 
and that of an optometrist. These were the main career areas that 
interested Larry and thus he decided to return to THS for his senior year 
in order to complete a well rounded education. While he regarded (CE)^ 
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as a "refreshing change" he is looking forward to seeing his THS friends 
again next year and does not anticipate any problems of readjusting to 
life at THS. 

His experiences in (CE) 2 this year would cause him to recommend fCE)2 to 
other students. While he felt a one year stay in (CE)2 was appropriate 
for him, he indicated that others might cont;;inue to gain from a two or 
even three year participation in the program. 

After completing high school, I.arry plans to eventually attend college. 
Some of the THS courses he will take next year he felt would be useful 
in preparing for college. 

Information obtained from (CE)2 in September 1975 indicates that Charles 
has petitioned to re-enter (CE)2 and has been readmitted into the program. 
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Section E. Case Study Findings 

Introduction 

. This^section of the report contains' the rationale and methodology used 
in seven student case studies, profiles of four students, and a set of 
tentative conclusions based upon all seven case studies. Since the 
individual student profiles are somewhat .long (even after editing) and 
yet contain valuable information about student behaviors in (CE) , a 
decision was made to present only four student pzofiles in the body of 
this report and place the remaining three profiles in Appendix G. 

Rationale 

Several factors suggest the use of case study methodology in the evaluation 
of the (CE)^ program. The program is new, complex and highly individualized, 
involving a multitude of interrelated learning strategies and environments 
and a wide spectrum of student outcomes. As such, it is not easily 
evaluated by a traditional nomothetic approach alone. 

Because the (CE)^ program is highly individualized, the case study approach 
to evaluation seems appropriate, it is in keeping with the philosophy and 
practice of (CE)^ and concentrates on the individual student. Thus 
outcomes directly related to individual needs are easily assessed. For 
example, it might be a (CE) learning goal to help a shy withdrawn student 
become iiiore outgoing or to Help an overly aggressive person become more 
restrained. Changes in these, two students would cancel each other out 
in a purely nomothetic approach. A case study, because it involves the 
student as tHfe unit of analysis, can capture this individualization and 
can documwt the effectiveness of the program. 

A systems approach to learning is employed in the design and operation 
of (CE) ilie learning strategies and management techniques are highly 
interrelated and interdependent. The holistic nature of the case study 
approach also fits well with a systems approach. It does not reduce the 
learning processes to independent isolated parts to be studied, but 
describes the Gestalt as it traces a student's progress, frustrations, 
and failurfts throughout the program year. 

The (CE) program is process oriented* It is the philosophy of th* 
program Ehat the medium is the message. Therefore, experiential Itarning 
is employed to help students learn how to learn. Unlike traditional 
evaluation methodologies which focus on outcomes, the case •tudy approach 
zeros in on the process o^ learning, its primary focus is the student 
experiencing the learning situation, it describes the student, the 
situation, and the Resulting intercjction of the two. 

Because both career education and (CE)2 are relatively new entities in the 
field of education, definitive descriptions of what is involved in either 
of them are not available. Both are evolving and changing. To precisely 
define either career education or (CE) or to make ultimate conclusions 
about their effects is not possible today. To fill the void in the 
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interim, case studies do provide empirical definitions of (CE) , Also, 
a case study can be a rich source of data from which to generate working 
hypotheses. 



Methodology 
1. Subjects 



(CE) 



.2 



students were stratified fi^tet into three groups: juniors, 



seniors in their first year in the program and seniors who were in the 
program also during their junior year. Within each of these groups 
students were divided into those considered by the (CE) staff as above 
average, average, or below aver<^ge in terms of demonstrated performance 
, during the first sixT weeks of the school year. Since resource 
constraints led the evaluators to limit the total number of .regular 
case studies to six, a decision was pade to randomly select students 
only from the above average and below average fcategortes from each of 
the three strata identified above. This stratified random selection 
resulted in a sampje of four boys and two girls. It was felt that 
this design would give^ a good representation of the students in (CE) . ' 
A seventh student, the subject of a limited case study in FY 74, was^ 
included to document a two year participation in (CE) . 

r 

2. Data Collection 

Multiple data collection strategies were used in this study to allow 
the evaluators to obtain a cross validation of information about each 
of the students. These methods included (a) observations bf case 
study students at employer sites three times during the year, (b) 
interviews three times a year with the student's eir^^loyer instructor 
at the time of observation, (c) parent interviews in March,, (d) indepth 
student interviews four times during the year, (e) informal discussions 
with program staff and (f) a review of student projects and other 
documents, A total of 23 records were also identxfied a$ secondary 
sources of data for each student and a set of guide questions was 
prepared for analyzing each source. These records include employer 
evaluations of students, student products,, test scores an<J staff 
evaluations.* 

3- Data Analysis and Synthesis 

' Because case studies can result in the accumulation of vast amounts 

of data that become difficult to analyze and integrate, the evaluation • 
staff felt it important to establish focal points for the case studies. 
Focal points used to organize and reduce data include: 

a. Student decision points (e.g.. Why did the student choose (CE) 
over other alternative programs?) 

b. Role relationships with peers, sfaff and employers (e.g.. How 

do the student's relationships with the (CE) staff compare with 
former relationships with the regular high school staff?) 



For a more complete description of data sources a id data collection 
methods, see EBCE student Case Study interim Report , NWREL, January ls.75. 
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c* student ability to see relationships in what they are 

experiencing (e.g.. Do the students perceive their experiences 
at the employer site: fitting in with what they are doing at the 
learning cepter?) ^ 

d. Student ability to match personal qualities with career demands 
(e.g., How do the students perceive their current ability in • 
Basic Skills in relationship with those skills required for the 
job they are exploring?) 

1 

e. Student ability to relate current! learning to future vocational 
and educational plans (e.g., How student' learning experiences 

fit into their plans for the futuie?> 

' \ * ' 

I _^ 

In addition to orgeuiizing data around prespecified focal points, 

evaluators also sorted euid auialyzed data to detect patterns of _ 

attitudes or behaviors in each student. These patterns were then, 
further investigated to determine how they related to the student's 

background eind v^^Jt ln4>act^ if any, the (^^) 2 P^°9^^-^^^ on.- them 

For exconple, if a student's past high school record and early (CEl-^ 
experience indicates a pattern of high absenteeism, this behavior 
becomes a prime object of investigation. If another student 
consistently demonstrates leadership, v^llingness amd adDility, the. 
investigation focuses on how the program capitalizes on this 
ability for the student's ssdce and that of his peers. 

J , • 

The conducting of a case sttJdy relies heavily on the judgment of the 
evaluation team eUid, for this reason, is very susceptible to evaluator 
bias. As case study data were assembled, the reliability and ^^lidity 
of the information were assessed by comparing evaluator observations 
with those of employers, parents, staff and the student himself and 
with data collected by other evaluation methodologies. Inconsistencies 
were then investigated and cleared up, or reported as Ifliresolved 
inconsistencies . 

When the narratives were synthesized for each case study* student, one 
final kind of empirical data was collected. Case study students were 
asked to read the draft of their own case study and to reflect on the 
accuracy of fact and of interpretation* The student's reflections 
were then incorporated into each narrative. ^ ^ 

In the subsections that follow, the evalu^tor''s reflections about the 
program's interactions with the student are offered at the end of 
each case study narrative. In order to .help provide a balanced 
interpretation of the data, two independent evaluators from out-of- 
state were asked to review the case study in a critical manner, 
looking specifically for the writer's bias and any unwarrcuited 
conclusions. All questionable conclusions were challenged, and 
either supported by empirical evidence or excluded from this final 
report. 
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student Profiles 



This sect ion \ provides a summary of selected data regarding each of four 
case study students—two boys and two girls. The remaining three student 
profiles on Mi^ke, Bob, and George are contained in Appendix G. Fictitious 
names have beeVi used to protect the confidentiality of individual student 
infonhationv the two boys described here, Fred was considered by his 
high school couijiselor as above average in self-directedness and was one , 
of 13 students guaranteed admission into (CE)^. He enrolled as a senior. 
Greg was a junio^ in (CE)^ last year and returned this y^r as a seniqr. 

'The (CE) staff t^ated him as below average in self-directedness in the ^. 
Fall of this yearl Evelyn entered (CE) ^ as a senior and was rated^by the 
project staff as below-^aver^e^Tji^self-airectedness Cheryl was rateS as 

.^.?!l^^«?,™F^^-i5..5SA-^^ junior year in (CE) . 

\ Fred f 



Backgrounds Fred fitst heard about (CE) in his junior year through two 
friends who were in the program last year. He decided to»join.(CE) as 
a senior because he fi^lt "so much hassling at higK.school"*4ffid thai he 
was being "treated like an ^.mposter there" when he needed fttention. He 
anticipated there would be "less regimentation" in (CE)^ and that he "could 
return to Tigard High School if he didn't like (CE)," He said he "wasn't 
learning anything in high school although I was getting A's." Fred felt 
that (CE) was for him ^ecause he- "weuited to take responsibility~fo^" 
himself." \ 

Fred and (CE)^^ First Semester , During his first few days in (CE) , Fred 
ffelt confused and had problems in learning to schedule his time an§ in 
meeting people. He "worried about what to do and expfect at the job sites 
and was shaking at first. Soon he found*that tho job siteg were "a 
lot looser" than he expected and got used to going there. 

Fred's pretest scores on a ^elf-report survey revealed that he was above 
the (CE)^ average** in self-reliance and in tolerance for people different 
ffom himself. His attitude .toward the concepts of "community resources" 
and "school" were negative, however. ,The attitude toward "schooL" score 
was almost 30 points below the JCE)^ average. This was consistent with 
his interview statements about high school. 

• i 

During Septe Tiber the (CE)^ staff noted that Fred was initiating his own j 
actions and following through ^well on tasks he had begun. He was falling 
a bit behind, however, in oompleting some project activities. In October, 
^Sf ^^^^^ noted that he was somewhat hesitant _ta go to employer* sites for 
explorations. The staff also agreed to encourage Fred to be a little more 



Unless otherwise indicated, statehnents in quotation ma^ks refer to 
comments made by the student during the interview with the evaluator. 



Wheo the term "above average" or "below average" is usfed in this 
^section It will mean that a student's score was greater th^ one 
standard deviation ^above or below the (CE)^ group mean for that 
variable, meaning t\\at less than 18% of his peers scored above or 
below that level. ^ 
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outgoing and -one of the staff volunteered to discuss with Fred his liRes 
and dislikes about job sites. Staff notes for the remainder of the year 
indicated that Fred was carrying out the (CE) activities on time, See- 
Table' IB for a description of his activities. 

This* year Fred coirtpJeted ten exploration levels including photography, 
carpentry, telephone repair and maintenance, sound recording, furniture 
design and law enforcement. These explorations lasted from tyO days to 
a week. In discussing these exploration3, Fred mentioned that "It's 
sometimes hard to get a job site you want because it's in demand," In 
December F^ed discussed his most recent exploration at the Tigard Police 
Department, He selected this site because Ixe wanted to "check it out and 
see what it's like and how they (the policed feel," He found that they 
hate to give tickets 'and have a lot of paperwork to do, "which you never 
see on Adam- 12, " 

While at the police department Fred interviewed a lieutenant who" explc ned 
the workings of the department and procedures for advancement, Fred also 
accompanied two different officers in. their patrol cars and obseived anc 
talked with the radio dispatcher. He felt that they were all interested * 
in him and willing to answer his questions, Mpst of his time at the 
police department was spent in observation and discussion rather than . 
active participation. They explained that they couldn't give him free 
access because of security regulation^ and therefore he had someone with 
him at all times. 

In addition to learning about the ^arious jobs within the department and 
the training necessary, Fred also investigated legal regulations on areas 
of personal' interest—like speeding, drinking' and youth curfew. It was 
good "just having a better understanding of what they (the police) are 
there for. They're not all pigs!" he said, ^ 

Was Fred interested in a law enforcement career? Absolutely not. He 
wants to be a musician. The (CE)2 employer relation specialist 
recommended that Fred "explore jobs related to music (sound recording, 
teaching, symphony) while continuing to explore other careers he selects 
from the employer list. These will be broadening experiences in which 
to develop other marketable skills," ' - 

Unlike most students who go on an exploration becau^ they^iiye considering 
a career area, Fred had no desire to become a law enfcrcement' of f icer but 
simply wanted to satisfy his curiosity about what they really do. From ^ 
his conversations with a police lieutenant, he became aware of the need 
for law enforcement *off icers to act impartially and maintain control 
over their feelings, Fred shared some insights into his own personality 
and its relationship to job demands, "They (the police) get a lot ot BS 
from people and can't swing back," He added'that he felt he couldn't be 
a policeman "because he would be tempted to carry his feelings into his 
job,-" He viewed the exploration level process as "the first step and an 
essential part of the total experience in (CE) ," In relation to the 
rest of the prpgraiff, it merely "touches on the outer layer of skin," 

Besides the five job explorations that Fred had completed, he also bpent 
a week at an inner city high school in Portland on a "special placement," 
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Table 18 

> 

TIME CHART OF FRED'S ACTIVITIES' IN <CE) 2 



Projects 


Sept Oct Nov Dec Jan Feb Mar Apr Maiy Jun 


Critical 'Hiinking 1 

2 

Functional Citi,zenship 1 

2 

Personal/Social 1 
Development 2 

Crea*"ive Development 1 

2 

' Science 1 

2 


1 1 (CEI2 Fox You 

/Critical Thinking Wrap-up Activity\—\ 

•Ara There Opposing Ways of [-; — | 

B6ing a Good Citizen? 

Where Do 1 Fit In?^ -| 

1 1 What Can I Do About Me? 

I 1 John Adaws High Schoo. 

1 1 Don*^ J usihstand there- 
Do Something 
Professional and Leisure Excellence\' \ 
Telephone Install, \ \and Repair 
I Was A TeeTiage ^—^Scientist 


Employer Sites 


Exploration 1 

2 
i 
4 
5 
6 
7 

? 
9 

10 

Learning Level 1 

2 


1 — \ Photography Studio < 
'H Furniture Stqre 
H Telephone Company 
* [— 1 Industry 

1 — 1 Police Department 
Public Defenders [-| 
Sound Studio * 
Arimal Clinic |-| 

DertistH 
< Restaurant[\ 

Telephone \ j Company 

High School \ — | (special placement) 


Competencies 


Credit 1 
Checking Account 2 
Insurance 3 
Income Tax 4 
Budgeting 5 
Physical Health 6 
Emergencies 7 
Electoral Process 8 
Government ^ 9 
Individual^ Rights 10 
Public Agencies 11 
Employment 12 
Automobile 13 


X 
X 

X ^ ^ 
" X 

X 
X 

, X 

X 

X 
X 

X 

X 
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Thi.^ IS a term used at (CE) to refer to an experience that a student has 
in the conununity that is not geared toward career developnient . in this 
case, Fred was interested in having an opportunity to J get to know some 
Black students and see first-hand what it is like to ittend a class in 
basic skills where all of the students are Bldck. He wrote up a Lifd 
Skills project plan which would provide such an experience. His learning 
manager, the (CE)^ staff member responsible for directing his learning 
activities, had vorked previously in an inner city high school in Portland 
with a high concentration of Black students and arranged for him to spend 
a week in a Title I program class there. ( 

\ 

Fred wrote a 13-page single-spaced handwritten journal account of his 
one-week special placement with the Black Title I director at the inner 
city high school. It contained a daily recounting of the experiences 
written in a flow of consciousness style interspersed with humorous 
anecdotes and glimpses into his own reflections on the experiences. He 
started by mentioning that he drove his mother's car to the Port^land 
school cmd in the walk from the car to the front door of the school passed 
more Blacks than he had met in his entire lifetime. His journal revealed 
his feelings of anxiety and his playing the drums with an informal Black 
jazz group Thursday at school, letting a younger Black boy try to play 
the drums r talking freely with some Black students that day, and having 
an extehded rap with one B}ack girl the nex^ day. By Friday he felt 
accepted by some of the students and expressed a real disappointment that 
it was his last day there since he couldn' t' arrcmge"^ to continue borrowing 
his mother's car the following week or arrange other transportation. 

The Title I director to whom Fred was responsible while at the inner city 
high school related to the UWREL evaluator that the week 'is experience nad 
been good for Fred. It was obvious that the director had shown a personal 
interest in Fred and in addition to allowing him to observe the classes, 
introducing him to students, allowing time for informal discussions with 
students, explaining the purposes and nature of the Title I program, he 
found time to take Fred on a drive through parts of the Black community. 

Fred and (CE)^ , Second Semester . Between January and March, Fred worked 
on a project fhat was closely riod in with his learning level in an 
installation and repair department of a telephone company. The objectives 
of this project required that Fred demonstrate, to the satisfaction of 
his employer instructor, that he could (a) verify that the reviuired 
telephone equipment had been loaded on the truck for a given day, (b) 
p '?ent a work order to a customer and discuss what needed to be done, 
(c; check out the work order requirements for the t^r/< of phones orde- ^d 
and the locationj v^ere they were to be installed, (d) identify impor tnt 
safety precautions in installing a phone, (e) install phone equipment. 
If) communicate responsibly with the dispatch office, (g) independently 
wind up a, day's work ^ich included filling out rviquired paperwork and 
returning wuse^l equipment, and (h) write an essay of several pages 
discuss^hg the positive and negative aspects of tne job in re lattice co 
his personal career needs* 

** 

Tht employer instructor at the telephone con^jany felt that Fred's largest 
gain while working in repaiz and installatipji was in learning ttow to 
^.re|,ate to adults including older people. "When he first came he was 
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reserved and when speaking with adults used much slang. Now he is less 
reserved and can speak without using slang* Also he has become nore 
self-confident." In addition to working closely with one en^loyer 
instructor Fred also talkei with and rode on a truck with other repairmen. 
His conversations about th^se experiences with his employer instructor I 
indicated that Fred had picked up on differences in attitude toward the 
job by different repairmen. Iri comparing Fred with other (CE) students 
who have worked at' the teic^^hone company, the supervisor indicated that j 
they treated Fred more like a regular employee than they have any other j 
(CE)^ students. 

i 

In talking cibout his experiences at the telephone company Fred said' that 
"at first I felt I couldn't do the work. I gained confidence with the 
help of the people there. I w^as give;: a '^hance and it felt ciood to be on 
my own and meeting the customed. It's a neat Reeling knowing that you 
put in a person's phone." Although being a musician is his vocational 
ambition, Fred indicated that he would, enjoy working as an installer and 
repairman. "It would offer security ana music does„.'t have job security. 
Communications are always needed. At the telephone company t.ie pay and 
people are good. However, you get rained on and have to take guff from 
some customers." In another interview Fred again referred to the fact 
that telephone men have to have patience in dealing with customers and 
that he was not. sure he would always have such patience. 

l<^April Fred spent four days on an ejcploration l^vel at a recording 
studio in downtown Portland. The company manager and shop visupervisor 
indicated t^a : Fred asked a number of good ques|tions, had observed the 
production of radio commercials and slide filmsjr had learned to edit 
music recordings and transmit discs to tapes, cu^d to do "fode outs.'* 
They alko said that he had received permission from anothei employee there 
to come in on his cfwn 6n Saturday to observe music recording. Ke stayed 
beyond the time required by (CE)^ during weekdays and has "iseemed to 
enjoy being here." The company manager's and shop supervisor's attitude 
toward Fred was perhaps best summarized when they said that they ^'let 
him handle the expensive equipment which they might not allow even 
regular employees to do during their first few months." 

Fred's desire for first-hand experiences is also revealed in. his vocational 
plans. He wamts to be a professional musician and already has an 
expensive set of driims and equipment, has taken years of music instruction, 
plays professionally and gives private drum lessons to children. He 
recognizes that competition in music is tight and he is open to the. 
possibility of other jobs if he does not work as a musiciam. Sdme 
experienced musicians have advised him that college iah't the best place 
for learning music and have en^hasized the importance of staining 
experience in actually playing with other good musicians. He isn't certain 
yet, because of the cost, about whether to attend college but would like to 
return to Los Angeles after graduating from {CE)^ to attend music school 
there, "study with as laany/ teachers as possible, and locate other 
musicians to play wxth." /Realizing that being a musician is not' a high 
security position, Fred said he could see himself working as a backup) in 
many jobs such as a telephone installer and repairman. Also he has 
considered law or medicine but is uncertain about his willingness to 
inyest the time needed in formal training.- 




Reflections by Fred . In summarizing his experiences this year, Fred 
cominented, "My (CE)^ experience so far has been more valuable than my 
total time at the high school." He indicated on a questionnaire at the 
end of the school year that (CE)^ was particularly valuable in lelpiiig 
him solve problems logically and was moderately ^aluabler^ltTlieTping him 
understand more cibout himself, geirtihg^ along with others, improving his 
communication skills, becou.ng acquainted with a broad range of resources 
to use in gathering information toi work cmd decision maJcing, knd in 
using information obtained through direct experiences in making decisions. 
Because Fred had already made a career decision to become a professional 
musician he felt (CE)^ was of little or no help to him in learning how 
his interests and abilities fit into potential careers, learning what to 
look at in considering a job, and in learning v^at basic skills are 
necessary for careers of interest. 

In reflecting on his perceptions of the greatest strengths and weaknesses, 
of (CE)^^ Fred stated that one of the strengths was that "the staff is 
together." Another strength is the opportunity to get out and meet people 
at the eit^jloyer sites. "You don't get that chance in (regular) high 
school. Here you get an opportunity to get into depth if you want it." 
Weaknesses in (CE)^ perceived by Fred includes "the hassle" of getting 
some competencies certified. He related an incident in which one certifier 
left him sitting in her office for almost an hour while she walked out and 
did other things. He also felt that there is' a lack of (Gfc;)2 communication 
with some certifiers v^o don't seem to know what is expected of them. A 
second perceived weakness identified by Fred was that the science 
pre^repaured project had some activities that seemed school textbook- 
oriented rather than community-oriented. Fred felt that the science 
project was the hardest for him because he wasn't interested in it. 

The Views of His Parents * In a home interview, Fred's parents indicated 
that they hoped (CE) would give Fred an incentive to finish high school. 
"He was getting bored at school. It was like a prison to him. Fred has 
had a much happier senior year in (CE)^ than he would likely have had at 
the high school. Kids don't really get things out of high school that 
carry on, beyond that time. Fred found that (CE)^ really Wcmts kids to 
open up. The high school doesn't encourage that. You can't just dump 
rules and regulations on them." His parents felt that (CE)^ has improved 
Fred's writing ability, has inspired him and has "self-propelled" him. 
"He responds well to the staff's push," they said. On a one-page rating 
scale listing nine skills that may ,,be important for young people to 
acquire, his parents indicated their perception that Fred was helped the 
most by (CE)^ in thinking through and solv^ing problemSf communicating with 
others in a mature way, assuming responsibility for himself and becoming 
more mature. There were no skills in which they thoiight (CE)^ had not 
helped their son. 

Test Progress Measures on Fred . The amalysis of Fred's pre- and posttest 
scores indicated that Fred had made substantial gain over the year on 
certain parts of the Coflprehensive Test of Basic Skills . In reading 
comprehension, he went from a 10.6 grade equivalent to 13.3, in 
arithmetic concepts he went from 9.0 to 11,5 and on the study skills 
section dealing with a use of references he jumped from 9.1 to 13.6. He 
gained slightly in arithmetic applications and remained at the same high 
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level in the graphics section of study skills. On tlie semantic 
differential instrument Fred remained constant in his attitude toward 
most concepts except for "school" where his^core jumped signif ncantly 
from 19 at the beginning of the year when rating the high school to 52 
at the end of the year when referring to (CE)^. On the student behavior 
ratings by (CE)^ staff, Fred was rated average or above average in all 
seven behaviors. The ratings inc^ ised at least one point on a five 
point scale on the following tr application of a knowledge of his 

own aptitudes, interests anr^ les to potential career interests; 

willingness to apply Basic -O work tasks and avocational interests; 

and assuming responsibility _ . carrying out tasks. He did not decrease 
more than a point on any of the traits, 

Eval tutor's Reflections , It appears to this evaluator that Fred has an 
above average ability to express his ideas and feelings orally and in 
writing. Fred appears to be a sensitive observer of his own ej^eriences. 
His case is interesting for several reasons. First, it suggests that 
exploration levels are serving a broader /function than that of providing 
specific knowledge about a particular career that a student is .considering. 
In Fred's case he went on several explorations not because he was 
seriously considering those occupations as careers but because he wanted 
to "check them out" in terms of understanding more about what people are 
like who do those types of work. Another characteristic that emerges 
from a study of Fred is a broad career development concept in (CE)2* 
Even tihough Fred entered the program with a clear idea in mind for a 
career, the staff and he felt it was in^)orteUit to explore a variety of 
additional career opt*ions and match these options with his personal 
interests and skills. Thus, it was just as in^rtant for Fred to reali:.e 
why he would not be suitable for law enforcement work as it was to confirm 
his convictions that he would enjoy being a professional musicicin. 
Although Fred was rather certain before entering (CE)^ that he wanted 
to be a musician the experiences in (CE)^ allowed him to explore other 
options as a backup to his first choice. A third point that Fred's 
case illustrates is the interest of the (CE)^ staff in the total develop- 
ment of each student and their flexibility in scheduling a special 
placement for Fred in an inner city location removed from suburbia, 

A fourth point worthy of note in Fred's case study is the cross validation 
of information avail2dDle, For exaunpler his oraL stat^jnents about high 
school were highly consistent with his attitude toward the term "school" 
on pretest measures. His high score in "self-reliance" on the 
Psychosocial Maturity Scale seems supported by the independent staff 
comments made about his initiative. Likewise, his high score on 
"toieramce" for people different from himself is highly consistent with 
his experiences during the special placement in the all Black class at 
an inner city high school. 

While Fred was strong in the praise of (CE)^ he was equally articulate in 
his criticism of the "hassle" involved in getting some competencies 
certified and in describing his dislike for the artificial nature of the 
science prepreparetl project. 
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Background , "I wasn't doing too ^ood in high schooj^. It's not that I 
wasn't able to do the work, it's Dust that I didn't^like some of the 
classes that I scheduled myself for and so I didn't attend tho^ classes. 
It came to the point where I was missing too many classes and I had the 
choice of either sticking it out at the high school or coming to (CEj^.--' 
I thought it was a program for dropout students." 

Faced with this cho-ice and with parental pressure Greg selected (C^E)^ 
and entered as a junior in April of last year. His initial feelings after 
starting were not atypical, "Wnen I first got here I didn't know what was 
going on, just confusion .but then when I got into the swing of things 

I thought it was really a fantastic program At the high school I was 

just^doing my work in the class and I couldn't see any further than the 
hiah school- In (CE)^/ everything interrelates ^o that you can see what's 
happening here and what's going to hai^pen when you get out, 'cause that's 
what this is all about, I think," 

Prior to entering (CE)^ Greg had worked as a dishwasher and as a janitor 
to make spending money. When completing the 2 application form last 
year Greg indicated that after completing his education he wanted to 
become a carpenter or musician. Pretest scores on the Self Directed 
Search indicated a preference for the artistic area, but the enterprising, 
social and investigative areas also were given strong weightings. 

Pretest data also indicated that Greg had average ability in Basic Skills 
and a particularly positive attitude toward the concepts of "community 
resources" and "school." However, his acceptance of role relationships, 
his attitude towards work and his tolerance for people different from 
himself were at least one standard deviation below the (CE)^ average. 
In addition, on (CE)^ staff ratings of student behaviors Greg was rat^d 
one standard deviation below the (CE)2 mean on "knows his/her own 
aptitudes, interests and abilities," "demonstrates willingness to apply 
Basic Skills to work tasks and 'to avocational interests," "initiates 
program-related behaviors (a self-starter)" and "assumes responsibility 
for carrying out tasks." He was rated two stcuidard deviations below the 
(CE)^ mean on '^applies a knowledge of his/her own aptitudes, interests 
and abilities to potential career interests." 

Greg and (CE)^, First Semester > Table 19 shows that by midyear Greg had 
completed one out of five projects started, four competencies cind only 
three Exploration Packages. He had, however, explored six different 
employer sites » 

After four employer site explorations of slight to moderate interest Greg 
struck upon one that re2^11y excited him-ran insurance company. When he 
first went there in November he thought it was a place where he could 
learn something about how insurance companies work. "And then when I tt 
got there it was data p*"ocessing and I thgught, wowl But then I started 
to get into it and it wi ' really fun and there was nothing in data 
processing that I didn't like Ev^n the hours/* Grfeg war impressed by 
the frieAdliness of the people,^ there . the thorough way they oriented him 
and the general opportunity to try out a ♦•esponsible position to see 
whether or not he liked it* 
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Arrangements were made to observe Greg during the second morning of his 
exploration in the data processing unit of Lho insurance company. During 
this 45-minute observation Greg was involved in keypunching his own data, 
using a sorter to alphabetize names and debugging an RPG computer program 
to list the names of his friends. The observation began with Greg 
keypunching a program he had coded. The employer instructor then showed 
Greg how to exchange disk packs on IBM 5445 disk drives. He then 
continued keypunching witTi some help periodically from the employer 
instructor who then showed Greg how to get a listing of cards on the 
computer, Greg proceeded with this until the list snagged with an error 
code. The employer instructor showed him how to look up the error codes 
and Greg located the mistake, Greg was then shown how to use the Sort 
program and proceeded to use it. He asked some questions and talked with 
the employer inst<1:uctor while the sorting occurred. 

An interview with the employer instructor followed the morning observation 
period. She related how Greg had read some manuals about computers the 
first day, observed their operations, ran a decollator and sorter, used 
the keypunch; he learned about disks, the card reader, the CPU (processor) 
and the printer. The employer instructor felt that Greg had^an adequate 
understanding of the* activities required by the job, fringe benefits, 
job skills and training needed, the career ladder in their data processing 
unit and a general feeling of what it's like to work there^^ She had not 
discussed salary or current employinent prospects with Greg, She also 
observed chat she enjoyed very much working with Greg and that he was 
dressed much more appropriately the second day thein the first. 

In talking with Greg several days later, he told the evaluatpr that the 
data processing experience had been his first exploration "in a white 
collar type of f ic^». , , .Even though I am an outdoor type person I liked 
that job site," 

According to Greg gains in general skills as result of doing rnore than one 
exploration were centered on communicatioits, '^When I first came in here 
(to (CE)^) I was hip, I talked all the lingo of my generation and I can 
still do that, I can now oullshit around with the kids here plus I can 
talk to a person like you and use a sufficient amount of good grammar. 
And that really helps." 

Greg described how he was using (CE) ^ to test out cdtreer optJ.ons, aptitude 
and interests: "I'm not using it as something that I could base a career 
on this year.... I haven't really thought of definite plans of what I'm 
going to do in the future. I see myself as still having a lot of ti»^ 
left. Even when I get out of here "I'm going to be doing some type of 
janitorial .. .work because as I see it there' not going to be too many... 
things open because of our ecoaomy the way it is right now," 

On a Learning Style Self-Assessment ^completed in early September, Greg 
stated that he preferred to "...learn at a moderate speed... not be 
pushed to hard.,, do thing(s) that are fun, ,, procrastinate. .. (get on me 
for procrastinating).,.." He ^ found the hardest things in school to be 
"math, homework, meet deadlines" and needed tne most work in "use of 
time" and "understanding what is expected of itiC," He also checked "takes 
me longer than it should to complete assignments" and "often need to be 
reminded about deadlines." 
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His self -assessment proved to be very accurate. Records of his (CE)^ 
leaminq manager indicated that, during each of the first three (CE)^ 
program year action zones, Greg was told by the staff that he was behind 
schedule in meeting his assignments. At the end of his second zone he 
and his parents were advised that at his current rate of participation he 
would not complete the year's requirements on time. In zone three the 
staff encouraged Greg to give serious consideration to whether he wanted 
to remain in (CE)^. After considering several alternatives he came up 
with a plan which called for him to complete zone four on target in all 
program requirement areas or no longer continue in (CE)^- 1^ addition to 
being behind schedule in completing assignments Greg missed several 
scheduled meetings with staff members, skipped school one day without 
calling in, turned in low quality work^and failed to report on a job site 
for two weeks. In addition to numerous conferences with individual staff 
members about his inadequate performance, he was denied use of the 
student lounge and required to spend more time at the learning center so 
that he could catch up on his work. In all, five accountcibility writeups 
were completed on Greg during the ,first half of the school year resulting 
in the contract to' complete zone four on target. 

Greg stated quite opeply that "I was being lazy and procrastinating and 
therefore I was falling behind in the program." Part of this behavior 
he explained was due to his feeling of "moping around" because several of 
the employer sites he wanted ro visit fell through, in one case because 
of a scheduling conflict and in another because the firm went nut of 
business. The turning point that he felt snapped him out of his depression 
was when the (CE)„ staff confronted him with the work he had not completed 
and "placed me in'^a spot %^ere I either wanted to be out or I wanted to 
"be in." He then produced the work and took it t9 them but "they said it 
wasn't good enough and it really shook me up a lot." Greg had a long 
talk with the (CE)^ student coordinator whom he likes and decided that he 
had been avoiding responsibility. "I finally realized that I was making 
so many excuses for myself that I really built up a front so that 

everything I did I had to mcike an excuse for I'm going to show that I'm 

really interested by working over Christmas vacation. — I hope that 
impresses them." 

Greg and (CE) , Second Semester . Greg did not complete zone four 
requirements on time and was asked to leave the program as provided in 
his written contract. Before leaving he did complete two additional 
projects, but still had two uncompleted projects and was behind in all 
areas of the program. After searching around for about three weeks, he 
was finally accepted back into the high schoox. He was interviewed 
again after being at the high school fior about "four weeks. 

Greg's Views of (CE) ^, Greg feelTs that although the staff wanted thinqs 
done at a certain time period, the rules at (CE)^ are so lenient that the 
staff can make them what they want. He feels that 'he qot "rooked" 
because he had more done at (CE)^ before he left than a friend of— hi^ ^_ 
did at that time* Ke was always told that his abilit^ wa- higher than 
his performance level. However, he likes the (CE)^ staff members, 
especially the student coordinator and the learning managers. 
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According to Greg, (CE) does not inform 'its en$)loyer instructors as 
mucn as they should. At some sites he was "pawned off by (the) contact 
person working as a second-hand." At other sites, he really didn't get 
that much information out of his explorations. However, he was forced 
to talk to strangers on these explorations — a very difficult endeavor at 
first. He also became more aware of himself and people around him. He 
had already worked in the community and did not find this particular aspect 
of the program as rewarding. 

Greg was unable to explore several of his cunbltions. One music site 
dropped out of the program before he could schedule his exploration. >ie 
also feels that a broader range of employer sites may be necessary with 
more employer relations speci'^lists to cover the sites. 

While at job sites, the employer instructors decided what things Greg y/as 
to do. According to Greg, some of these did a good job, some did nothing 
at all, and some considered the program to be for dropouts. Several of 
his projects were written around explorations, but Greg dici not really 
find many of these sites of interest to him. In fact, he didn't find 
any interesting jobs besides computer programming. 

At this time Greg really had not thought about a career. He was simply 
interested in getting any job he could get to get out of the house. He 
has decided that the restaurant business and carpentry are definitely not 
for him. The former orrnpation was eliminated because of Greg's 
experiences outside of the (CE)^ program, v^ile the latter decision was 
made following a (CE)^ exploration. He said, "I don't want to be a 
carpenter. I was there and found out that I had a problem with sawdust 
in my nose and I didn't like it. I wasn't really into metal working or 
wood working at high school either. It just didn't appeal to me.c I 
always thought that was something for people that weren't very smart. 
But then I found out it goes into as much depth as most things. I just 
didn't liy". it. But I was going to try it anVway since this program is., 
for me to make my decision e^ither way." 

However, he does prefer outdoor work and wants a job that he can forqet at 
night. Two years from now Greg would hope to have his own house and share 
it with a friend, obtain additional music equipmer.t and live his own life. 
He has discussed these plans with his friend. 

Greg las found thatjCE)^ is " — about the same as working at a job..." 
because you have to produce on your own and meet certain standards. When 
you don't n^et these standards you are asked to leave. You must use your 
time efficiently and be able to communicate with adults. You should 
"work first — goof off letter." 

The arts are preferred by Greg because of some of the associated work 
values and habits. Greg wants to be more lenient with his time, not . 
follow a strict orientation and prefers long hair. 

Since Greg will soon be out on his own, he realizes the importance of 
learning to communicate with adults. Before entering (CE)^ the t^nly 
adults he had to interact with were his parents — cmd they were always "on 
his back." Through his experienc^es in (CE) Greg now realizes that there 
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are -all kinds of adults—both good and bad— and he feels that (CE) has 
helped him to communicate with them better, ^ 

Greg's Comparison of (CE)^ and the High School , After being asked to 
leave the {CE)^ program Greg simply wanted to stay home and play- the 
guitar. However, he knew that he had to go to school. His present plans 
are to finish up any needed credits beyond this year and get his GED at 
the community colleqe, 

Greg now likes hiqh school better after leaving {CE)2 than he did before 
entering (CE)^, Before entering (CE) Greg did not use his time' very 
wisely at the high school. He uses his time better now and says this -is 

perhaps because of (CE)^," Greg said he was doing more, sinqe he 
returned to i:he high school than during his previous two years dt the 
high school. He had never really done much written work before Entering 
(CE) , but the program made him Write, The program also made hirt think 
about how to use his time and to consider the effect of his actiohs. He 
no longer just does what is fun. He attributes this increased reaiponsibility 
to (CE) and says it has helped his high school grades jump from .5 to 
2,0. ^ ^ ' • 

Problems at (CE) ^ seemed bigger there than at the high school. There was 
a family thing at (CE) and everyone seemed to be against him. Now, he 
knows that he has an effect on people around him, 

Greg feels freer at the high school ^even though the regulations are 
stricter and he attributes this to the constant change of studer^ts. He 
feels that he has more time to himself, 

Greg finds that students at the high school think of the (CE) ^s a program 
for "dropouts and goof-offs," He finds it^very difficult to explain the 
curriculum to another student. However, he strongly recommends the (CE) 
program to "students who knpw they have to work and get something out of 
school," He would not recommend the program to "people who get stoned' ^ 
all the time," 

Finally, Greg has some recommendations f^ the (CE) program. He feeJs 
the learning center should be aWay from the school—especially for the 
counselors and uniqueness of experiences. It should be an escane from 
school. In addition, (CE)^ needs separate workxng. spacps for students 
such as a quiet space, a music lounge and the like, 

Evaluator's Reflections , The richness of student quotes in this case 
study was due to the fact that Greg could express his feelings so clearly. 
Several aspects of this case study are revealing. The first is the way 
in which the (CE)^ staff worOced patiently ,^with Greg in trying to help , 
him recognize the "games" he was playing and to make a mature decision . 
about whether or not to remain in (CE) . A second point of interest wao 
the tremendous* impact on Greg's outlook caused by suddenly discovering 
an employer site ani career possibility that excited him. 'it's hard to ? 
imagine a classroom event that could so affect a person's perspective; 
A third insight gained from Greg's case study is a better understanding 

the nature of experiential -learning as it relates to career education. v 
For example while at high school it v/as easy for Greg to stereotype 
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students who take wood shop cl^as^e^as'-'^TTaC^eing too smart." By actually 
exploring careers in the' community Greg learned that carpentry is more 
challenging and goes into more depth than he realized." 

There may be some truth to Greg's contention that he was "rooked." ^t 
the end of the third zone, Greg had conpleted two- explorations, one 
competency and one project, while Evelyn completed only one exploration, 
one competency and one project. Greg had four absences at. the learning 
center compared to Evelyn's two and no absences at weekly meetings 
compared to Evelyn's one absence. In addition, Greg had'-missec three 
journals while Evelyn had not missed any. " Greg and Evelyn had similar - 
mathematics scores and although Greg wa« significantly higher than 
Evelyn in reading comprehension, he had substantially lower study skills 
scores. In spite of this a contract was written resiuiring Greg to 
complete four projegts, four explorations and five competencies by -the end 
of zone fcfur. He completed only one project, three explorations and three 
competencies. If this same contract had been written for Evelyn, she too 
would have been asked to leave the progrcun since by the end of zone four 
she had cbmpleted only on« '^project three explorations, and two 
competencies. In fact, even^ Cheryl, who was* considered to beof-mi^ch 
higher ability, Completed only three projects, two explorations and two 
competencies by the end of zone foQr and would not have met the terms of 
the contract. Although Greg had entered the program in April of the 
•previous year asid had to do three ^ex**!^ projects, iT seems that the 
standards are highly flexible. Such ^occurrences are perhaps to be 
ei^pected in any iridividualized program. 

A final point of interest iji Greg's case study was his ability to profit 
from his partial year in (CE)^ after he returned to the regular high 
school. Instead of bfeing more disillusioned and resentful of school, he 
seemed to have made a good adjustment and, in fact, performed better in 
sc*iool than he had prior to entering (0^)2; This tends to indicate that 
some of the attitudes and skills students acquire in (CE)^ are transferable 
to other environments. When interviewed during the summer in response to 
the first dr^^ of this case study, Grejg revealed his intentions to take 
courses this fall at the coiranunity college in pottery , poet ry^ -and ^ 
perhaps .music theory or psychofogy. 

< 

Evelyn 

Background . ' Evelyn comes from a -family tliat feels strongly about pro.yiding. 
support for their children, especially in their educational endeavors. 
Last year while at the high school, Evelyn skipped classes on several 
occasions. When her parents later found out and realized that they had 
not been notified by school personnel, they were very* upset. Her parents 
see (CE) • as providing a valuablj? learning opportunity and they strongly 
endorse the program., ' 

The fir^t impressions of (CE)^ by Evelyn were that "it was a good idea 
because you get ou% in the community more and you learn more about what 
you want to be doing ^then you get out ojf school.^ Last year I didn't know 
what I wanted to do so I wanted to get into ( (CE) ) and try to figure 
out what I v^anted-to do when I jt out of school.^ * ' ^ 



82, 

93 • 



A new senior in the program, Evelyn decided to apply to thef program after « 
k (CE)^ presentation /Wap made at the high school. Her parents "didn't 
real / know what (the program) was at fiyst, and then when they started 
coming to all of the meetings and the parent conference^,. ♦ .they really 
appreciate it now ^nd feel that the staff has a lot of . dedication to the 
kias.*\ Evelyn said "I wanted to bring myself to go out into the 
community by m^^s^l^f to learn more about whctt different jobs were that 
I had heard about but didn't really know what thny were." ^ There was 
nothing th^t she didn't like initially about the program. • 

Evelyn was not ,hesitart about leaving her friendis at the high school 
"because it was time, to get to know more people than just the people I 

hung around ^with Everybody thought that I wouldn't associate with 

them after I got into (th^ program), but that just isn't true because 
I think I .have leamc:d mdre here and been more understanding about thing^. 
And it's not like I used to be, really shy toward people and this has 
helped me as I am' noct so shy around other people." 

Evelyn, chose (CeJ^ because she was bored, didn't like the high school and 
Wcinted more freedom and indepen<^ence. These reaiSons correlated with h^r 
attitude towar'^ school which was significantly below the (CE)^ |)retest 
average rating, but did not agree with her average self-reliajsice rating. 
Most of her basic skills were at or aboye average, but her reading 
comprehension score was somewhat below average. This score was 
consistent with her general dislike for reading. 

Evelyn and (CE) , First Semester ; By mid-year Eve^n h~ad^^TOmpleted ohly 
one project, although she iiad, begun two other projects. She had also 
co/npleted just two competencies. (See Table 20) 'However; the staff 
reported that her- attitude seemed to be ''improving and she had been 
checking in morfe often with staff members.- Hdr handwriting on activities? 
had improved, she seemed mors concerned cind'her work, when completed, was 
of good quality. 

In the 'opinion of the staff, Evelyn was not \ising employer sites effectivel 
Shfe had gone jput on six explorations, but had only completed three 
exploration packages. Sh^ did f^el that these explorations could be fitted 
to certain projpnfq. For instance, she wanted to do a project on drugs 
and plcinned to* go to a jnedical site for help. For a creativity project 
she had to locate a site that had something wron4 with-it and recommend 
three changes that she thought would b^ goo§ for that place and then have 
the employer sign off* on her' suggested changes. ' - 

Evelyn went ,to a horse boarding farm for one of her explorations "because 
I like horses and I jus|: wanted to see what kind of things (the boardirig 
farm) did." This particular site was chosen after tallying with a fellow 
stiudent who had already completed an exploration activity at that site 
and told her what/fehe .c?ould expect* At the site, Evelyn spent much 'of 
her time observing riding"* lessons, but also led the horses out to pasture 
fed them, cleaned barns and bed stalls and learned the general operations. 
She felt she made good use of her time while at the site and didn't just 
sit around. ' . ^ 
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Table 20 



TIME Chart of evelyn's activities in (ce)2 



Projects" 



Critical Thinking 1 

' 2 

Functional Citizenship 1 



Personal/Social . 
Development 

Creative Development 
Science 

ILA 



Sept Oct Nov Dec Jan* Feb Mar Apr^May Jun 

: '■■ n ■ — ■ 



(CE)2 For You 



Critical Thinking Wrap-up Activiti^^ 
Where Do I Fit In?\ 



^What (Can I DO) About 

Budgeting the \ {-Household 



Don' t Just^ 



-|sta/ict There 



X'Was a Teenage 



\Sc 



Growing Herbs \- 
Mathematics -f- 



Communications [— | - 



Employer Sites 



sentist 



Exploration 



. 1 
'2 
3 

. 4 

5 
6 
7 

8 

9 

10 



No Learning Levels 



j 1 Batik t filler 

\ \ — \ Photo reproduction 
. ' I — \ Horse farm 

Animal qliKiic\ — | veterinarian assistknt 
Telephone repair and [—\ service schedule 
» Photo f-| reproductioi 
[] Florist 
j Garden shop sales\-\ 

Kennel assistant\^ 
4n i fnaX_uait«4M-Fia« ^sistant [~-| 



Competencies 



Credit 

Checking Account 
Insurance 
Income Tax t 
Budgeting 
Physical Health * 
Emergencies 
Electoral Process" 
Gov^^rnment 
Individual Rights 
Public Agencies 
Eihjtiayiient 
Automobile 
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The employer instructor found Evelyn to be very attentive and she, in 
turn, enjoyed her experiences, *'Most places I've went (sic) out to I ' m 
really nervous the first time into the exploration level. Here (the 
employer instructor) jyst made you ^el like you were just v^ne of his 
fellow workers." 

Evelyn found out th^t horses need a Ijt of care and attention. Persons 
working with horses need to stand up ^ lot, love horses and not show 
fright, be outgoing and be cible^to stand the sjnell of the stable.v. She 
said, "I I'ike ho^c^ses and I like to be outside, I like to be doirg 
somett>ing all of the time and^ not just sitting around for maybe two hours 
and then getting out and doing something." j 

There were several things which Evelyn was unable to 1 learn at this* site, 
mainly because 'the employer "instructor was busy much bf the time, ^She , 
wanted to "earn about the various breeds of horses an^ how they, react 
to diffetciit things, how to braid horses tail^ and/or manes, and how to 
<^iwe riding lessons. Evelyn; h^ped to learn these things at another 
employer site. 

Thus far, Evelyti's exploraticjr^ had not really matched her career plans. 
She wanted to be placed "in ^'dentist's office, but (the employer 
resource specialist) couldn*t%et one,,, until December and so I 3ust 
went out on different places that I thought *I got to Sgo and see what 
they do,*" Her interest at the horse farm was more of a recreational 
interest, since she was roost attracted to becoming a dental assistant, 
or possibly working in a bank. Evelyn likes math auid felt that her 
math basic skill's woul<f be sufficient for wOik in a ba^k. Because of 
her explorgftions she decided that she would not like to become involved 
in the development land processing of pictures, » 

Fvfclyji's plans for the future at this tl^ie called for completion of high 
school follov^ed by dental school- She contacted a dental training school 
and planned to go for an interview in the near future. These plans were 
discussed vith her parents and both she and her parents discussed them 
"with the student coordinator at a parent conference, ~ ^ 

At first a very quiet, shy and hesitant person, Evelyn was becoming more 
open aiid^jpg" ponding positively to the J[CE) ^ envii^nment according to her 
learn iilgmanager. However, she often allowed her friends to interfer:^ 
with her wprk progress, was very reluctant^ to initiate her own productive 
activity and heeded considerable staff attention and support. 

During this tiiive period there were six accountability writings (staff' 
checks on progrtess problems) maide on Evelyn cohcerning overdue exploration 
packages, phoney excuses for non-job-site attendance^ failure to se(^k 
job placements And cin oyerdue proj^ct^. Many studei^t staffing comments 
were negative and included: • "not doing a>thing," '^attitude »^ improvinq/ * 
checks* in more/quality work/better handwriting on activities/more • ' ^ - 
concerned," "emergency on job-sites/doesn't check in/hard to place/no 
enthusiasm indicated (re: going oyt on ^job sites) /doesn • t crowe as much," 
"dragging feet; upset ea^ly when ccmfronted by staff for not following 
through on meeting contract commitments," arW "good follow-through on 
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explorations/turns exploration packages in immediately/choosing 30b 
sites on her owii." Obviously,. Evelyn had her ups and downs during this 
period. 

Evelyn and (^E) ^, Second Semester . By the end of the year Evelyn had 
completed ten projects (including two in an ILA basic skills), ten of the 
eighteen exploration sites she had initiated^ and all 13 competencies. 
She had* completed no learning level activities. The exploration activities 
ranged from the telephone company and a photographic studio through a 
florist and garden shop to veterinarians and a kennel. 

The exploration at General Telephone in\^estigated the activities of a 
scheduler for telephone installations and repairs. The employer instructor 
was Evelyn's mother -and Evelyn arranged the exploration to find out more 
about what her mother's work involved and why she really g^ts tired. 
While on this expioratior Evelyn added totals, located files and posted 
orders, but did not complete any of the repair reports ^themselves . 

The observation of Evelyn's third day at this site betjax^ wittt her reading 
off addresses for repair and installation sites to the eW)loyer instructor, 
her nother. As she read each address the employer instru\tor explained 
the grid system on the map and Evelyn posted the location wa.th a grease 
pencil. As they worked, the employer instructor asked Evelyn several 
, questions -regarding the report forms and aided in pinpointing locations. 

After finishing this activity Evelyn went to the employer instructor's 
desk to check on late arrival requests and Evelyn secured a file order 
requested Jpy the employer instructor. This .activity concluded with the 
employer instructor initialing Evelyn's time sheet. 

The employer instructor stated that ^elyn conducted the exploration 
interview and seemed to understand the activities required by the job, 
the job skills and training necessary, the level of basic skills needed, 
the salary and fringe benefits and the opportunities for advancement in 
this field. Although the employer instructor said she b(^iieved Evelyn 
knew what it felt like to work there, she also mentioned that Evelyn 
left the job site before the busy time of the late Afternoon. Evelyn 
used her interview guide to conduct an effective interview with the 
employer instructor, recording comments verbatim. 

Both the contc^ct person at General Telephone and Evelyn's father dropi>od 
out of high school and expressed understanding of the importance of 
having a program like (CE) ^. Evelyn's younger sister is quite active 
and involved in the high school, but Evelyn was just the opposite. In 
fact, Evelyn tends to be lazy and is less mature than her sister 
according to her mother. 

Evelyn said that she had plenty to do at the telephone comp.iny site and 
wasn't bored even though it wan routine work. She had some idea in 
advance about the site, but did not realize that it was so complicated. 
Although she found the work to be fairly easy, it was hectic and 
fatiguing. 
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The cK:>nt,act person at the telephone conipany said he believes that students 
.should (^xplore th<^ (.\«nmer«^:ial area first and learn how installation and 
repair orders are received and written up before posting orders. 
Althquqh Dvf^lyn agreed, she doubted she would go back for that exploration, 

liven thqugh her mother was tiie employer instructor Evelyn felt that she 
was treated like an employee. She was able to ask questions and liked 
the site because she likes to file and answer the telephone. There are 
no skills which Evelyn felt she lacks for this occupation. 

Through her exploration activities Evelyn felt that she was becter able 
to communicate with adults and more able to i^peak out with her ideas to 
different people. She has also learned how to better cope with situations 
and get a better idea of the resources available in the community. 

Evelyn' had been working on her mathematics and communications skills on 
the ILA. However, she did not feel that she really had been acquiring 
any applied skills. ^ 

Thusi far Evelyn had decided, that she definitely did not want to work itx 
a snack bar, sell furniture or things of this nature. At this time she 
had an interest in the field of veterinarian "assistant , but had not 
made a definite decision. 

The most important thing about (CE) to Evelyn had been the opportunity 
to meet new people and she especially' liked the way the staff treated her. 
She got to be with her friends, but also had time to be by herself. 

Evelyn spent some time back at the high school, especially at basketball 
games, and still had some friends there. She found little change in her 
soci^^l life since entering (CE) . However, she said, "I think I got to > 
know the staff here (at (CE)^) better than the teacher^ over there 
(at the high school) because here you can talk to them individually where 
they have, like, 200 students or more that are in their classes and 
you can*t really talk to them that well.... I can talk to the people here 
more openly than I could when I went to the high school and (as a 
result) I've learned more. ...They treat me here as an individual where 
over there they" treat you as a whole group." 

Evelyn was also observed on the third day of an expLoration while working 
as a kennel attendant at a pet kennel. While at the kennel'she swo[)t 
floors, cleaned dishes and pens, emptied the washer and drier and folded 
blankets, fed and ^-xerc^sed -pets according to directions and did some 
grooming. She performed most of -these activities during the period she 
was observed. 

Evelyn was ^judged to adequately know the activities rec^uired by the job 
and what it feels like to work at a kennel. However, the employment 
prospects are slim and the employer instructor was unsure whether Evelyn 
knew much about the salary, fringe benefits and c\pportunities o^ the job. 
Most of the information she collected was from observation and direct 
xnstruction. The employer instructor only worked part-time and was 
unsure whether Evelyn had yet conducted her interview with the owner. 
However, the employer instructor ha.i also worked with previous (CE)^ 
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itudents unci eri joy^-'cKthe relat^onshLf^s. Students; were "-more help t-hau 
Fiiridranco" and did not 'take qp/too much tiint;. " ^ 

While on. this job site Evelyn I\ad little opportunjity to' apply her ba?>ac 
skills. The employer instructo^ did note that one did not pay enouqh 
atteriMon or listen closely and was not capable of adequately followinq 
all of a series of directions.- 

t) 

f:velyr\ felt that the job was pretty ea?/, althouqh different animal ^I 
required different foods and medicat i jns . She did have enough to do and 
was notr just sitting around. Her employer instructor treated her as 
though 'he was a regular employee, according to Evelyn. 

Althoiigh Evelyn would have li^ced to observe some animal training, there 
was none occurring at the t-.me. She felt that she learned everything 
that her employer instruc^^or did at the site, especially being gentle 
with the animals. \ Also^ there was nothing that she feels she cannot do 
or IS not qualified to dp and she enjoys working with animals. All m 
all, Evelyn really, r/ijoyed this site even though' she was unable to add 
or change activitic^s. ^ 

Durinq the second half of the school ye ir Evelyn wa-^ --'^Yi^i- ly behind 
'in he^ work. ^ch end-of-zone debr.iefing was filled with problem areas. 
In addition^ there was a parent conference and another conference with 
the studecc coordinator. Her lack of time input resulted in a require- 
ment to 4ttend gfter-school time make-up sessions. Ip addition, there 
•were erght accountability write-ups made on Cvelyn concerning lack of 
employer site maintenance, not turning in time slips or exploration 
pacVages, and failure to keep appointments at employer sites. 

Pa example of this failure to keep appointments was evidenced during her 
exploration at the garden center. A time was set up to observe Evelyn, 
but^ she left the job site and returned to the learning center before the 
appointed time. A second- appointment was set up with Evelyn and the 
employer relations specialist to observe her on the following day. When 
the observer arrived he was iriformed that Evelyn had called in sick with 
a toothache, but had not bothered to inform her employer relations 
specialist or the observer. When thp observer returned to the learning 
'center he found EVelyn sitting in the lounge drinking a soft drink. 

Finally, Evelyn's lack of part^-cipation in job sites re§,ulted in an 
ultimatum. A contract was drawn up containing explicit provisions for 
expected job performance. She was to select an entirely new joD site 
by the following day, meet all schedules and times while on that job 
site with no unexcused absences, turn in her completed exploration packet 
for that site by a specified date, attend no other unassigned job sites 
nor accompany fellow students to their job sites, schedule? all remaining 
projects with target dates and complete all work on journals. If any of 
these provisions was, broken, Evelyn would "...automatically and 
immediately be asl^ed to leave the program permanently." 

At this time Evelyn's work year really began. From this date she cdmple^- 
six projects, six competencies and two explorations. Thus, in less than 
six weeks she completed sixty percent of her projects, almost half of her 
competencies and twenty percent of her explorations and she was able to 
graduate with her class, 
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Reflectio ns by Evelyn . Since joining {CE)^ Evelyn feels that she has 
"been able to talk to people more'easily . . . than just running away from 
them...." She sai^d "I can let my feelings out... I jus\t don't hold them 
inside....'"^ "In t*he first of the year I'd -just. . . tellUies just to get \ 
attention from people .. .because I felt -like I wasn't getting enough 
attent ion--that people would just pay attention tp somebody else and-'^rget 
all about me so I'd make up lies... so they'd pay atrentioii to m^."^." 
However, she ".'..just started thinking about it and Jfound>^lf*s easier 
to tell the truth. .. .It's a lot easier — you don't have to think up some 
quick lies . . . . " 

Evelyn finds the real world "kind of scary but (she's) hippy this is her 
last yee'r and (she dpesn't) have to get up ir. the morning." A i^roject on 
Budgeting the Household for a month "...really gave (her) a good idea of 
what is going to go cfn." She wants to'move out of her home and get a 
place of her own but first has to get a 30b and some money. 

Because of her experiences in (CE) Evelyn felt tiiat she can better relate 
to adults. She said "I can look at their opinion just as I can^mine 
instead of locking my mind." She feels adults are "...the same as us 
except they are a little older and know more." She also felt that now 
she is not as scared to do things on her own or go places by herself.' 

Two years from now Evelyn hopes to be working in a veterinarian's office 
as a veterinarian assistant. She had been thinking about this career for 
about five months; These plans were discussed with her parents, the 
student coordinator and her employer relations specialist. 

Veterinarian assistant was a switch in careers from the beginning of the 
year.'^' At that Jtime she was decidedly in favpr of a career as a dental 
assistant. Because of scheduling problems she was unable to explore this 
career until mid-Decj^mber . While on this exploration she decided that 
this career was 'definitely not for her and. did not even complete her 
exploration package. She vividly recalls one event, "This was weird, 
but the first day I went out there I was with the hygienist and she was 
cleaning tnis giiy's teeth, and they were all green, you know, and she 
was picking the green 'stuff off^ and I had to sit' there and -hold the 
suction cup thing, and, he had blood all in his mouth, and I kept getting 
the suction cup stuck to the sides of his teeth, and he'd go, 'Wuspps,* 
and I'd -go 'Ooops,' and I'd pall it out." 



Evelyn felt that (CE) has helped her to know herself. She said, "I 
know what I want to do and what I want to be and whpre I want to^go." 
•She also "can talk with her Mom bette-r than (she) could." There are no 
areas in which she made less growth this year than she had hoped to make. 0 

The Views of Her Parents . Evelyn's parents first heard about (CE)^ when 
Evelyn told them about a seminar discussdng the program which was presented 
at the high school. They hoped that the program would make Evelyn l|^ss 
introverted, better able to relate to people arid give her an idea of 
what the "outside" was like sq^as to give her ideas for the future. 

By mid-March Evelyn's parents were really "turned on" by the 2 P^^^^^"^- 

They said the program had done more than ^ they thought it would. She never 
talked about her experiences at the high school, but now would go in streaks 



89 



V 



talking about hc-r iCK) ^ ]ob site Gxporiences. Evelyn would ev^n argue 
with her parents, where before she was very retic^ iit and submissive. 
She had also become move critical, questioned others wh^n she felt shp 
was right, expressed her feelings and looked people in the eye wheh talking. 

Acv-urding to her parents, the (CE)^ program had most helped Evelyn to be 
more consj.der^te of other peop;.e and to accept more responsibility. Her^ 
parents really did not expect miracles of the program but hoped that it 
would help Evelyn to be able to develop a fnore definite plan of what she 
wants to do. They found out that she no longer wanted to become a dental 
assistant or work in a snack bar but they hhd to initi^ite most of this 
kind of discussion. ^ ^ 

Evelyn's parents felt that she had -improved a lot in written and oral 
communications, but her mathematics skill "has always been good." They 
did not know what she was doing in Life Skills, but did know that- she 
had been out on quite a few job sites. They, also felt that punctuality 
was always one of Evelyn's strong points. The (CE)^ program helped^ 
Evelyn very little in "preparing for college or future education" but * 
helpeS a little in "communicating with others in a mature way," 
"demonstrating tol^ance for others," cind "becoming more mature," according 
to her parents. ^ ' 

The (CE)^ staff kept Evelyn's parents well-informed — "much better thaT^ the 
high school." Both her mother and father had meetings with the staff 
regarding Evelyn and were highly impressed by the ability of the ^^E) ^ 
staff and their int'erest in students. Most of .the time the (CE)^ staff, 
especially the student coordinator, contacted them, although her father 
also contacted the 6taff. If there, had been no Contact the parents said 
they surely would have initiated some. ^ 

The" information Evelyn's parents received included where and what she was 
doing, how she was doing, apd what she needed to improve on^. In parent 
conferences, the staff praised as well as mentioned problems. Evelyn's 
parents also felt that they could have made their opinions known to staff 
members. The only information the/- felt they had not received was what 
types of job sites were available and what Evelyn was going to see. 

Problems encountered by Evelyn which her pare'nts noted included her . 
penchant to put off work until the last minute and a fear of going out 
to job sites and interacting with strange people. These problemi were 
som^hat resolved by forcing'Evelyn to make and stick to a time schedule. 
Both parents were satisfied with how the situati^on was handled and are 
st<ong supporters of the (CE)^ program. 

One example of pareaal involvement in the program in Evelyn's case 
concerned one of hc;r projects. Her parents worked with the learning manager 
to set up the project "Budgeting the Household." In this- pro ject , Evelyn^ 
was required to take full responsibility fo5: running the house for a week. 
She paid the bills, shopped for food, cooked the meals, cleaned the house 
and the like to get a feel for what running the household was like. Both 
parents were very impressed with this project* » • 
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^ Evelyn 'b Views of i ^-^) - ^ ^ Evelyn felt that her. project work did not fic 
into her 30b explorations, she did tyjo pro3ects incorporating mathematics 
but used this^ basic skill only at hfer bank exploration. She was able to 
do a separate/ project on herbs while at^he garden canter* She also found i 
several 5f th^ explorations to be rather boring. The only general skill 
she felt she gained out of attending multiple explorations was "being 
-^ataent with people." ^ ^ 

Evelyn indicated tha^t' (CE)^ wa§ helpful in all areas in in end-of-year, 
questionnaire. However, her lack of variance in response (she marked "4" 
on a f ive-pcint scale) for all 22 items probably is 'representative of 
little thought given to each question.* She rated the "overall quality 
of the' {CE)^ program as "excellent" and would definitely decide to 
participate in (CE)^ again. Evelyn felt that you could progress in the 
(CE)^ program at your own irate, but rated (CE)^ about the same as the 
high school on opportunity for "learning about "occupat ione , " "t^neral 
learning," and for motivation to learn. She stated that there were no 
program weaknesses "and that the greatest strength was that "the staff 
members are alj. he^ful and there when and if you need them." 

Test Progress Measures on Evelyn . In the area of Basic Skills, Evelyn 
increased one grade level in arithmetic concepts, arithmetic applications 
and study skills using reference materials, bat decreased, in reading 
comprehension ,and study skills using graphic materials. At the end of 
the year she was i^t least three grade levels below the national norms in 
reading comprehension and study skills. She was also more them one 
standard deviation b^low the (CE)^ reading comprehension mean on the ' 
posttest. 

'# 

On a semantic differential' instrument , Evelyn was siqnficantly below the 1 
{CE)2 mean in her attitude toward the concept "school", at pretest time 
and "learning'' at posttest time. She made gains' 6n all scales over the 
year except for work and d ecision making and her gain oh the school scale 
was significant.* 

On the Psychosocial Maturity Scale Evelyn had posttest means at least one 
standard deviation below the* (CE) posttest means. She had significant 
declines on the self-reliance , role ^ social commitment ^ tolei'ance and 
change scales. 

^The social occupational area was still strongest at posttest time on the 
Self Directed Search but the conventional (e.g., clerical) areaf moved up 
from third (out of seven) to second and the enterprising (e.g., sales) 
area jumped from las*t to thifd. Meanwhile, the realistic (e.g., mechanicalT 
araa dropped from a tie for third to last (seventh) . 

The (CE) student coordinator and ^he appropriate learn inq manager rated 
each student on a five-point scale in No^mber and again in April. Evelyn 
was one standard deviation or more below the (CE)^ mean at the -time of the 
first rating on each scale exceat "demonstrates 'willingness to apply 
Basic Skills to work tasks and TO avocationaj interests." At the time of 
the final rating Evelyn was more than one standard below th^^ (CE) mean 
on only "knows his/her own aptitudes, interests and abilities." She made 
jains of at least 9ne point on each of the other six scales according to 
staff ratings. 
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Evaluator's Reflections . A problem revealed through this case €tudy wa§ 
discovery of a very poorly written thank you letter which Evelyn sent .to 
the employer instructor after the exploration at the horse farm. Although / 
this letter consisted of only two sentences, it contained two grammatical 
errors. These letters, and all student products which are distributed to 
* the community, shoulc* first be screened by (CE)^ staff members so they 
might better identify which students need additional help and maintain a 
better program im^e in the community. 

A concern was also expressed by the en^loyer instructor at the horse farm. 
He felt that the program was excellent and enjoyed workinc^ with the . 
students. However, he also felt that students at his site did not get 
a realistic feeling of that site because of their time period of attendance. 
Since this work is wide in scope, it takes more than two days to get. a 
good idea as, to the variety of activities. In addition, the students 
came at 9:00a^m. after the morning work had been completed and left before 
the afternoon chores really began. This situation illustrates the 
necessity for variable lengths and hours of exploration depending on the 
individual learning site. 

*<■ 

It should be obvious from this case*' study that even though Evelyn graduated 
from the* (CE)^ program, at times she'was very'^lazy and difficult to 
motivate. ' It was hoped that job sites and- the reality of work would be 
enough stimulus to Overcome this problem. Unfortunately, as her mother . 
stated, ''the program could not perform miracles." 

Evelyn has an obvious handicap which she stilly must overcome. Admittedly, 
she does net like to read and her reading comprehervsion is still at the 
elementary school level. In addition, she appears shy and reticent. 
However some s^trides have been made in her speaking ability this^ year. 

Evelyrv was the only (CE)^ student who^did not participate on a learning 
level acitivity this year. The (CE)^ staff felt that she needed exposure 
CO a latger number of different people and sites more than extensive 
interaction wit.i one site. However, interviews with her indicated that 
she now only superficially understeunds the requirements and responsibilities 
of a veterinarian assistant, even though she explored this career at two 
different sites. 

A final observation conccrps the progress which Evelyn made during the 
year. Ey the* end of April she was performing Jfar below the levels .of 
acceptability. Only by giving her an ultimatum to produce or get out 
did she finally begin working. Up until that time she had done quality 
work (according to the staff), but little of it. She completed just 
five exploration packages of the 18 explorations she had scheduled. 
During the last, six weeks of the school year -she was then able to complete 
over 45 percent of the total year's work. Evelyn used very little of her 
potential ability unless she was dramatically motivated. 

Cheryl 

Background s On the evening of the orientation for prospective students 
and their parents, Cheryl had the -flu and was unable to attend. However, 
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htir mother attended the meeting and was so enthusiastic about the program, ^ 
that she encouraged Cheryl to apply. (Theryl did apply even though her 
friends thought of (CE)^ as a dropout program^ 

Cheryl was not selected from the applicant poolxDf students,* out entered 
the program as one of the first alternates in the beginning wedks of the . 
school year. Cheryl said, "I don't know if I thought (CE) was going to 
be easier or not, I just thought it was something drfferent that I would 
be able to use morfe after I got out of high school thian the regular 

classes I was taking then, because I didn't want to take them so T 

thought that this is- really going to help me 1 cein control what I 

want to'' do and.... push myself to my limits, if there are any." 

Although only a junior, Cheryl has a "goal of travelling arouxid the 

United States after (she) graduates " She wanted to obtain skills which 

would give her a start fqr the future and might also be applicable during 
,her travels. Through (CE)^ she said she has been able to further these 
travel plans, through talks with her learning manager and her friends. 

Cheryl had little previous work experience, consisting only of babysitting 
and fetrawberry^ picking in order to earn spending money. However, she felt 
that learning about careers and prepafring for a job were extremely 
important factors ir> her decision to join (^^)2* especially 
interested IRi exploring the work of a physical therapist. 

On*\he Comprehensive Test Of Basic Skills , Cheryl performed about average 
on the arithmetic subtests and slightly above average, on the reading 
comprehension and study skills subtests. She rated above the (CE)^ average 
on the identity and self-reliance subscales of c. maturity inventory. Her 
attitude towards "decision making" was also above average. ^'These scores 
reflect Cheryl's self-cpnfidence in her abiliti%s. All of her other 
scores were at 'the avej^age level of the (CE)^» students. 

While at the high school Cheryl had participated* in the American Field 
Service Club and the band. She had intended to pursue her band interest 
further chis year while in (C£)2f but did not since band was a middle-of- 
the-day activity at the high school and might have interfered with her 
(CE)^ activities. However, she stated that she could have participated if 
she really had wanted to. 

Cheryl and (C£) , First Semester . By mid-year Cheryl had con^leted two 
competencies, three projects and two Explorations (see Table 21). She 
was also working on a learning level and two additional projects. Cheryl 
comes from a very religious family and completed one of her project|^in 
connectioFi with her attendance at a convocation over a religious hoiTaay. 

For four of her projects, Cheryl took it upon herself to incorporate some 
additional mathematics work. She had not inned on taking any math this 
year and has not had a math course since t ninth grade. However, through 
(CE) and her community involvement she saw che necessity for acquiring 
additional mathematics skills. 

Cheryl completed exploration packages for a disc jockey at a radio station 
and a flower shop worker, '^en firs( observed, she was into the tenth week 
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TIME CHART OF CHERYL^S ACTIVLTIES IN (CE) 2 



Projects 



Critical Ihink^^g 1 

2 

Functional Citizenship 1 



Personal/Social 
Development ^ 

/ 

Creative Development 

Scienb& 
ILA Math 



Employer Sites 



Ej^loratioA 



Lesirning Level 



Sept Oct Nov Dec Jar. Feb Max Apr May Jun 



(CE)2 For You 
What's it I 



Like t^Be Blind 



Where Qo I Fit In? } 1 



4 Insight Into the Bible 
1 What Can I Do About Me 



Petals h 1 and Thorns 

Don't Just Stand Ther^l \do 

Somethino 
^ \Re ti \ rded 



Workihg with Adult Mentally} 
I Vas a Teenage Scientist 

y ] IIA Math ^- 



H Florist 

\—\ Radio station disc jockey 
Elementari^^ school EMR aide . - 
Junior high school | — [ psychologically disturbed aide 
Activity Center \ — | TMR aide 
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of her loarninq levex at the flower shop. At the flower shop she made 
flower arrangements — mo3tly small ones such as corsages — and cleaned, 
watered and otherwise took care of the cut f-lowers. She also did small 
errands, folded^boxes , did some sweeping and.-liked to observe -^e^ flower 
9 arrangers, although her employer instructor preferred her in an active 
, role. She was also able to ,incorporate*t)ne of her creative development 
projects, "Petals and Thorhs," int© her experience at the flower shop/ 
although/ h^r employer instructor stated'^during an interview that sha 
^ was "not awar^ of the project. . • 

In Studeift Performance Reviews by her employer^ instructor, Cheryl received 
mostly commendable and excellent ratings** She received "excellent" 
ratings for her courteousness and cooperativeness , poise and self- 
ponfidence and "progressively requiring less supervision.". Employer 
instruc':qr ratings indicated that she improved her observance of employer 
rules, understanding and accepting responsibility, completion of assigned 
tasks, using initiative and seeking opportunities to learn, and used 
increased judgment. At the same time Jier employer instructor rated her 
lower on the ^second rating on adheranc%*to established schedules and 
demonstration of, approprictte dresff/grooming. " ^ 

Her employer instructor also felt <that Cheryl has sufficient basic skills 
to enter this occupation ^with some additional experience, but did not 
discuss this possibility or Cheryl's futur.e educational or caj^eer plans 
with her. Cheryl showed interest in the career and some enthusiasm and 
self-cohf idence according to her employer instructor, she also understands 
. and communicates very efftictively with .adults, is cible to work by herself, 
asks questions and uses employees to get '..iformation, thinks about what 
she is doing before acting and is fairly mature. However, h^r employer 
instructor felt that Cheryl n^eds to be more alert and does yiot have ^ 
realistic understanding of what it is like to be a florist. 

Cheryl felt that her employer instructor was quite demanding and sometimes 
impatient. However, she enjoyed this* learr^ing level and felt that she 
made good usfe of her time. She felt that she learned everything about the 
job site that she wanted to learn and can use the- site as a future 
reference. Cheryl ^as able to decide what she wanted to do at the site 
.although her learning manager wrote up the activities. . 

Cheryl felt that she was treated like a visitor at' first, but later more^ ^ 
like a worker. When observed, Cheryl appeared to get along very well with' 
her co-workers. She values learning how fe real business is run and 
, lean ing about the flower business although she is unsuis^e about whether she 
wants to set up her own floral bu.iinesy some day. Cheryl has al^so learned 
that customers must treated extra special ♦ , 

J. ' ^ " 

Cheryl saiji, * : have figured out that I am going to- have 'to discover...^ 
alternatiJve types of jobs so that I can figu>'e out ^h^ one diat is best ' 
suited fcf me so that I can really enjoy my work better because if I am 
not happy I won't do the job.'* She feels she probably would not work uhtil^ 
she is out of high school and then only until she had married or started ' 
a family. Although she had' not really thought about work before entel-ing 
(CE) , she has since had several discussions with, her lealnning manager 
about work values. At this time she viewed work only as an end to eam 
money for pu , a^es."^' 
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The (CE)^ staff noted Cheryl * s cheerfulness, creativity , enthusiasm,^ 
reliability and highr quality Work. ^Sl^e recognizes het weaknesses and ^ 
works to improve them according "to their comments. 

Chejy^ and (C£>) , Second Semester . During the second half* of the year, 
Cheryl completed t^ree additional explorations, six more, competencies and 
seven .additional projects. She has*also partially completed three of - 
the remaining five competencies whj/ch she must con^plete as a senior next 
year. , ^ ' ^ * * 

The ;additional explorations were as an aide with 4JI educeible mentally 
retarded class, counselor and teacher of-* trainable^ mental retardates and 
as a- special education teacher. Her interest in this area girew out of a * 
project on blindness an^ encouiragement from the atudent coordinator, who 
"pushes special education." It eventually led t9 cin extended Reaming 
level as a special education teacher at a work activity center for ' 
trainable "fen tally retarde.d (TMR) adults. * . . ^ y 

Two observations were ijjgde oi Cheryl'S^^at that .site. * Th§ first observation 
waa^made during the iihird day of her placement following ax) exploration 
at the same s'ite. Cheryl was the assistant for a' group leader in a ^ 
classroom of 12 students. After some initial discussion and demonstration 
on how tb threSd an einbroidery needle, Cheryl began working with the four 
students at one of the tablets. She had already learned thdir names and 
worked individually with students showing them how to measui^e and cut 
thread, thread a needle and then tie the thread into a khot. 



Cheryl spent extensive tme working individually with he students.. One 
student failed to understand' the concept of "twice" when inst^-ucte^i by 
the group leader, but neith^ the group leader nor Cheryl ex^ilained that 
it means two times. Studants were then instructed as to how to cut their' 
own 4x4 tinch piece of material, with Cheryl again giving much individual 
attention. The activity closed with a clean-up period. 



The next class consisted of only 'two extremely retarded students. Cheryl 
began working with an individual student, explaining a scissors and its ^ 
use. With sufficient, prort^ting, Cheryl was able, to get her to say 
"scissors." Cheryl ^hen explained the structure of the needle^ith its 
eye and introduced thread and how to measurfe it. As the observation 
enj!ed, the student "had cut her thread and liad begun to thread the needle^-. 

Even though Cheryl had only been on this learning, level for three days her 
employer^ instructor felt^that she. understood the a^BU-vities Required by 
the job and'what it feels lik^ to work at the centerN^ This feeling was 
probably based on' her four previous explorations in the field of special 
education, including one at this site. The employer instructor also ^elt 
that Cheryl has the^ empathy and interest to work with this type" of 
student. Cheryl wanted to look af^^ individual differences in ment;ally ' 
retarded students by working with kll three levels of students on 'one 
particular project. Her primary responsibility was to implement an • 
individualized program in basic life skills based nn the g^oup ^leader • s 
instruction. , ( 
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Cheryl's employer instructor stated that sne has an unusual willingness 

be cooperative and displayed self-conf idenc.e and initiative. She 
exfh>t)ited her interest in the area of special e4ucatioii through the 
genera^taon pf good ideas for projects and her desire to come to the 30b 
site eveftxthoaa^h she was already busy on another project. 

By the end of February she had a good idea of what field she wanted to 
work in. It shoul< be a useful job—and that is how she feels about 
special education,' St^e» had b^en encouraged to further her experience^' 
and education in specialv^education by personnel at the four previous 
exploration sitee/ r . 

Cheryl felt tJj^.^while at this si^t;^e she wc^s being treated "basically like 
a volunteer, although sometimes li-k^^ staff member." She iikes to wcrk 
with" othejt people, buV^dmits thab sinc^ she only works a five -hour -day, 
she hasn't fully, appreciated what the "real".3ot> is like. She finds the 
work can be quite e>.haustihg when working with "kids who are spaced out," 
but feels she is doing something wolrthwhile. ^ 

Cheryl fj[lt thai: she really had not known what th^CCE)^ prpgroLm was all 
about' earlier in the year. By mid-year she was able to state tlwt she 
could confide in practically All of the (^^E)^ staff \members , but an prior 
^ears had'not had any similar relationships with memb^ers of the high 
school faculty. Further, she stated that "studer\ts- ate to learn at 
(the high school)^ and .^r'e treated that way; here to learn at (CE) , but* 
also aware of problems of becoming an adult a^^i make yon -feel wanted. 
learning i5 fun t^iis way cind learning was a pain at the high school... 
learning is something you had to do there and you have to do here^ but 
here it really, Soesn't seem like it." 

At the second observation at the worlc activity center there was a Noticeable 
differe'nc^ in CHeryllg fole. She had assumed much additional responsibility. 
The original group leader, had , left the^ center and a college student 
replacement hed been seetfred on a less than fullVtime basis. Cheryl now 
had more experience with the' students than the ♦new group leader. In fact, 
the new group leader was ill on the day of .the second observation and 
Cheryl conducted the classes by herself. 

s{^he »cl^sfe which was observt^d met, in the regular classroory, but was 'taken 
outside by Cheryl. They wex*e then seated aroin^ a picni^ table on the 
rear porch of the aqtiyity center. . ; 

A female student had a magazine with he>" which she continued tp look at 
and would not put away when^ Cheryl requested, ^noth^ staident then tried 
to take the magazine and^ Cheryl /re^ponde^ by VQrJDally reprimanding the 
studenl:. A male student contirtued to stand through the magazine episode 
and would not sit down^ at the table . ^'Cheryl theri told the rest of .the 
class *to ignore. the*se students, but'^ald these studeitts they could jain . 
the activity when they were ready. ^ ' ^ \ • 

The lesson for the day first concerned a rfeviaw of the basic food groups 
and nutrition. Although s'tudent^s often ^ried to take off on their oy/m 
'diversions, Cheryl did a good job of -keeping them on the right track. 



#The second activity was a paper and pencil basic writing activity. By 
this time all of the students were becoming involved. Oqe student 
request'ed that they 'be allowed to listeh to the radio and Cheryl agreed. 
Each student was given a card containing his name and some other items 

^ to use as a cuide for che writing activity. Cheryl helped individual 
students print heir name, praising students where appropriate. After 
about fifteen minutes Cheryl changed the radio station. One student 

, objected, but finally agreed to the change for awhile. Cheryl instructed 
one student as to the correct way to wear his watch, and wound the watch 
of another student who said his had stopped. The activity was concluded- 
by the returri of supplies. Cheryl put the supplies away leaving the 
stu(i^nts unatt^nde^W temporarily, but returned quickly. 

The employer instructor noted that Che/yl had been supervising gioups of 
*educable mentally retarded students independently at^he center and 
. assisting in ^e teaching of academic skills such as number recognition, 
writing skills, money skills (including the use of money), food survival 
skills (including menu planning, nuCrition and purchasing), shopping 
skills, 'cooking skills su^h as tools, measuring and food preparation, ^ 
leundry skills and clothing care, persona] hygiene, sewing skills, 
clean-up skills, etiquette, and some work training. In addition, Cheryi 
completed a, project comparing the ability le^^els of students. 

On employer instructor ratings Cheryl gained or increased several specific 
3ob-related skills from this learning level experience including taking • 
and following directions and supervisory skills. She exhibited a definite 
willin«9ness to pick up these skills. Although Cheryl has the attributes 
necessary^ for this job, she would probably need a degree in special 
education before she coulJi be -hired. However, the center would hirfe her 
immediately for a position as a stunmer aide if the; funds were availal^le. 

There are several general career skills which Cheryl obtained or improved 
by )ijorking wr£h trained staff personnnel and by working in a practical 
situation^ These include her dependability*, * promptness, flexibility^ 
conscientiousness and value of. commitment. She was commended by her 
employer instructor: for her emp ly for the problems of others, her good 
judgment and her ability to seci^ jlarif ication when she was uncertain. 
She demonstrated her initiative by developing a laundry program by 
•"^K^rself to eliminate some of the smell from clothes and towels. Cheryl 
xs extremely mature and watches the well-being of her students. Vf>ry 
few of those skills could h--^ been learned in a conventipnal classroom 
according to her employer instructor. 

All of her ^tuijent Performance Review ratings were either "commendable" 
or "excellent-"' The final review also included the^e^ comments. "(Cheryl) 
was^ n^ver late or the wrong place at ,the wrong time. Also., always 
called in if any change in', schedule .. .always willing to do any task with 
cheerful attitude. . .^has reaJLly utilized time allotted for her learning*... 
ddes super job of all tasks; congenial and well-liked by all staff .has *. 
unusually'^mature capability to maintain proper rapport between her staff, 
clients d?id employer contact." 

Her employer instructor further said that she is. able to work cooperatively 
with other people towards a comxnon goal, question the. right people when 



l09 



^98 



she has a question, do her ptoject work independently, ask for printed 
resou* jes to secure additional information and make notes about what she 
IS doing. She showed a real interest in the site by doing an exploration, 
asking to finish the year there on a learning 'level and asking related 
questions beyond these necessary to complete her projects. 

According to her employer instructor Cheryl found the work to be demanding. 
It held nonm^asurable rewards and slow gains weie very important. The^e 
understandings reflect the real world with the mentally retarded. 

According to her employer instructor, Cheryl made gains in both oral and 
written communication skills while at the job site and shoved a willingness 
to apply these skills. She worked wi£h numbers whenever given the chance 
and rewrote one paper completely when the first dra^t was not very lucid. 
Although she frequently blushed and had difficulty formulating questions 
early in ^e learning level; she is now much more verbal and not as quiet 
and hesitant. 

At the end of the learning level, Cheiyl felt that the tasks at this site 
had been very challenging and she had used her time to the best advantage. 
She had been tre^ated like a regular volunteer or employee and was always 
busy doing something. She was able to do what she wanted to do with the 
employer instructor's cooperation. She completed four projects while on 
this learning level and received help from the site staff. 

Cheryl felt that th^, most important things she learned at^ this site were: 
communicating with and reacting to mentally retarded students; coping with 
special problems; acquiring some teaching and learning skills, including 
hovf to get a point across; understanding the feelings and emotions of 
physically and emotionally handicapped persons;- cqntrolling her own 
emotions; and, coping wit,h the mental strain. She felt that she was able 
to learn all that she wanted to- learn and got a good feeling of what the 
field is like, especially when she substituted for staff members who were'' 
absent . 

Cheryl believes she has the personality to work with the mentally retarded 
and knows that she will need at least, two years of college, aljthough she 
has not definitely committed herself to the additional education. However, 
she still wants to travel, but "would go into special education if (she) 
went into any career." 

Reflections by Cheryl . Recognizing her deficiencies, Cheryl has worked 
to improve them. She has attempted to incorporate mathematics into each 
of her projects and completed one project op ILA math." 'At the high school 
and at the beginning of tne year, she had difficulty getting into her 
work, but feels that she is better at it. She now better programs her 
work allowing enough time, to get her work done. She said, "The time 
zones that we have (here in (CE)2)'are closer .together^^than they ^re at 
the high school and you have to get... in a way you have to get more 
things done... and if you don't have them done you get in conflict." 

In the past, Cheryl really had not thought much about £he world of worX. 
Since, she has been -in {CE)2 she has been doing some thinking -and hAs ^ 
decided Qn some things she does not want to do. She "decided that (she) 
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jiist didn't want a ]ob in a factory or. - .assembly line... but needs to 
have something that she can get (her) personal satisfaction out of and 
• think that (she's) done something." Knowing that "...in this age you 

can't get away from work to survive " Cheryl needs to know that she 

.las ".^.done something that is really worthwhile." These values have 
been influenced by her experiences at work sites while at (CE)^- She' 
said "...when you are looking for a job site... first of all you have to 
think whether or not you are going to like it at all and that ju - kind 
of comes naturally. . .you decide if you^' re going to like 'it by your own 
values and if you don't have any values it's going to be pretty hard to 
Sfigure out whether you are going to like it or not."^ 

Although Ch6ryl did not have difficulty talking to people she really knew, 
she found it beneficial "...learning to go out to a job site and just all 
of a sudden "seeing somebody and you have to learn what they're doing... 
you have to become more aggressive. . .or else you really won't get much ' 
out of it^. " Going to the job sites also .give Cheryl a realization! of 
jvlst how tiring and exhausting it is to go to work, which in turn gave 
her some insights into how her parents feel at the end of a working day. 

I • 

As far as future plans two years from now, -Cheryl^ is considering two 
alternatives. She could have earned enough mopey to go travelling 
around in Europe and the United States or she* could be getting an education 
going to college, hopefully in the area of special education. However, 
she has not discussed these jlans with anyone lately and they ♦are presently 
indefinite since she still has one year of high school remaining. 

Cheryl fe3ls.that the (^^^2 P^o9^^"^ staff have helped her basic overall 
growth. The outgoing nature of the staff, the cadres (group student 
meetings) and the job sites have helped her make new friends, increased 
her ability to talk to people and enabled her, to get to know adults better. 
She has also learned that the staff and employer instructors can and will 
give help when it is needed. .-^^ 

The Views of Her Parents . Cheryl's parents had 'mixed reactions initially 
about the iCA) program. Her fathei: was somewhat apprehensive at first, 
fearing that Cheryl would be missing out on some associations at the high 
school. However, her mother knew that Cheryl was bored at the high school' 
and (CE) looked like a chance for her to do more things and some things 
she wasn^t getting a chance to do. When interviewed in March they both 
stated that Cheryl was getting something valuable in the way of learning 
experiences at (CE)^ and nonmeanirigf ul things were not being forced on 
her. They both feel it is valuable tp get^ome of the practical, physical 
things. 

Her parents feel that they are being kept more informed of Cheryl's 
progress in {CE)^ tshan when she was at the high school. They would -not'* 
feel hesitant; to call {CE)^ staff members and feel they have the 
opportunity to mAke thei.r opinions known. However, most communication^ 
has been initiated^y the'(CE)2 staff including what Cheryl is doing and 
accomplishing, her attitude and, particularly, her ^mathematics progress. 
They /(^^ould have liked to receive additional inforrtatj.on conceding what 
happened on employer sites and what skills she yjas developing. They like 
the reporting mathod of showing program Expectations and progress. 
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According to her parents, Cheryl has been real excited about her 
experiences, but may have not known enough about a particular exploration 
site to make a decision. Thus far, Cheryl ha^ had no real problems. She 
talked about her experience^ several times a week including her experiences 
with the mentally retarded students, other students at (CE)^. the student 
coordinator and employer instructors. She has even brought some of her 
work (a corsage from the florist shop) home with her. The only thing 
she really ever talked about at the high^chool was band. 

Cheryl has always b^en looking on the horizon as far as careers are 
concerned, but ^nothing has really crystallized. Since entering (CE)^ 
she has developed good working associations with people and has discussed 
her travel plans with her parents. She does nat want to be tied down 
doing one thing allof the time and her parents have encouraged her to 
be open-minded about the future. 

Most of the changes in Cheryl noted by her parents since entering (CE)^ 
have been minot. She is now more ^entnusiastic about schooling and people 
have more of an effect on her. She is a little more independent and 
socially anteractive cind is cdnipetont to qet around by herself. Her Parents 
feel that {CE)^ has not adequately helped her associations with peers and 
her social life, but Cheryl s'^ys that she has more good friends at- (CE) 
than she had at the high school. 

The {CE)^ program is meeting Cheryl's needs in the Basic Skills, e3pecially 
orar communications, and in the development of knowledge" about careers 
according to her parents, - However, ^he development of job skills is one 
of the biggest values of the (CE) program and helps students become 
"capable of being involved in society," 

Two weaknesses of the (CE)2 program were identified by Cheryl's parents. 
First, they would have liked to have seen more learning level activities 
as Cheryl ,had only had two learnina levels thi^ year. Second,, her father, 
feels that it might have been better if students had put in more effort 
and had»,more consultation before going out on job sites. However, her 
mother feels that the present structure of the program he;Lps the students 
decide which job sites to attend, 

Cheryl's parents feel that (CE) has helped Cheryl very much in the areas 
of "thinking through and solving problems" and "becoming more mature,!'. 
The program has also been beneficial ip helping her* in "communicating 
with others in a mature way" and "assulring responsibility^ for self." 
Although no definite, decisions have been made her parents also feel that " 
Cheryl "has^jnuch more direction for the future than she had before 
entering (CE)^" in the areas of "preparing for college on f.uture education" 
and "preparing for work," ^ * 

Cheryl's Views of (CE)^ . At the beginning of the program Cheryl didn't 
have any negative feelingg toward the program and has become even more 
positive 'toward it since September, The enj^oys the freedom and likes the 
lack of homework at (CE)^, even though she feels she has had to worK 
harder than at the high school. She found her (CE) experiences "very 
helpful" dn helping her to solve problems logically get along with 
others, learn how her interests and abilities fit into potential career's, 
learn what to look at in considering a job, improve her math skills, 
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communicate comfortably with adults, take responsibility for her own 
actions and become more open to ideas and values different from her own. 
She also rated her (CE)^ experiences tp be somewhat helpful in seven 
other areas. 

Cheryl round tl3e (CE)^ program to be "of' little or no help" in helping 
her improve her reading skills eind communication skills (speaking 
and writing) . She also ;t:ated the program as providing only minimal help 
in learning how to find and •keep a job. This l^ick of career knowledge 
was reflected in a ten item instrument on career planning where Cheryl 
only had fivQ, correct. \ 

Cheryl rated the {CE)^ program as providing "much i.K>i?e" opportunity them 
the regular high school in providing for learning cibout occupations and 
motivation to learn, with "more" opportunity than the regular high school 
m providing for general learning. She rated the overall quality of the 
(CE) program as "goou* (4 on a five-point scale) and definitely would 
decide again to participate in {CE)^- The program also allowed her to 
progress at her own rate. ' 

In an open-ended question Cheryl stated that the greatest strengths of 
the (CE)^ program are "the closeness cf the staff and students. . .the 
ra*^ 3 of staff and students. . .the understanding of staff members (and) 
their ability to help with problems." 

Test Progress Measures on Cheryl . Several differences were noted in 
Cheryl's scores on testing instruijvents between pretest time and posttesting 
Cheryl made a significant gain in readij^g conprehension going off the 
upper end of the conversion chart. She also increased 1.6 grade levels in 
arithmetic concepts, 0.6 grade levels in ^arithmetic applications arrd 2.1 
grade levels in study skills using references. She was at or eibove the 
(CE)^ mean on all scales at posttest t.ime. 

A semantic differential showed a significant gain on the concepts of 
"community resources" and "school" with little change in her other scores- 
There were few significant c>^ iges in her scores on the Psychosocial 
Maturity Scale but her pos tcot scores we^e significantly above the (CEl^ 
posttest mean on all scales except for se|.f- rel iance and change . These 
posttest scores were quite different from^ those for most (CE)^ ,§tudents 
for the overall means either doplin^d or showed little difference on 
each scale. Cheryl's ^cor^s on th^^ Sfelf. Directed Seaxch for the top 
three areas were the s^e, but her .social and enterprisinq areas wfere 
scored much stronger and both surpassed the artistic area which qreatly 
decreased in strength. ^ 

The (CE) student coordinator and the appropriate learning 'manager rated 
each student in November and again in April. Cheryl was one standard 
deviation cibove the (CE)^ average on four of the scales and two standard 
deviations abowe the {CET2 average on the* other three scales at pretest 
time. HoWliVer, at posttest time she was one standard deviation cibove 
the (CE)^ posttest average on only two of the scales ("assumes 
responsibility for carrying out tasks" and. "understands another person's 
messa»je and feelings") and showed a significant decline on two scales 
("knows his/her own aptitudes, interests and abilities" and' "initiates 
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program- re la ted behaviors — a self-starter") • These scores do not reflect 
Cheryl's overall behaviors in the program.' While at the learning center 
towards the end of the year, Cheryl tended to just sit aroiind a table talking 
with her friends an(liiiaf ing^, Sirtce the ratings were completed- by staff 
members who were basically in the learning center, . these ratings reflect onVy 
that behavior which occurred m the learning center. However, her employer 
relations ..specialist stated that her work while at the job sites was 
"outstanding." Apparently, all of Cheryl's time ^d efforts went into her 
30b site activities (including pro3ects) and she coasted v^ile at the 
learning' center. 

V 

Evaluator's Reflections , The flexibility of the (CE)^ staff to meet 
individual student needs is reflected in their interaction with Cheryl 
and her philosophy of work and future career plans. Cheryl was not forced 
to adopt someone else's philosophy of work, but instead her philosophy 
has been allowed to evolve out of her experiences in the real world. 

Cheryl's career plan has also evolved out* of her (CE)^ exper'i^nces. *In 
th3 beginning of the y^r she only wanted to travel eind her only career 
interest was physical therapy. As the ye^r progressed she wa^^ able to 
focus het career interests into special education- Although she, still 
has some plans for travel, her work and career interests have increased 
over^the year, , « 

It was very interesting to observe the conflicting behaviors between job 
site and learning center which occurred towards the end of /the year. 
Cheryl wa"s very focused eind purposeful while on the job" site, btit aiimless " 
and lackadaisical at the learning center. These differences in behavior 
may be ^illustrating a preference for experiential le^arniug over 
learning tent^er participatipn. 

Case Stii^ies Concl usions - ,\ 

Although generalizations based on seven case -studies {four detailed cibpve 
4nd three detailed in Appendix G) must remain tentative, some qpncluoions 
cire offered below: 

(CE) appeals tp a wide range of students . * - 

Contrary to some prevailing notions that career education programs^ 
• appeal only to students with blue collar career expectations or to 
students from the lowest end of the academic spectrum, the case 
studies present evidence that students with a wide range of vocational 
aspirations (professional, musician, dentist, "powdermem, " etc, ) and 
varying degrees of success in school make up the (CE)^ sttident 
population. It is also interesting to observe the variety of reasons 
why students select (CE) ^ as 'an alternative, Fred was "getting A's" 
in the high school but not learning anything. He joined (CE)» in 
the* hopes of finding "less regimentation," Bob joined when his high 
school grade point average dropped from 3.5 to 1,6 and he felt himself 
on the road to becoming a droppyt. Evelyn joined iji otder to force 
herself out into the community ^andf find out about^lW variety of 
careers that might interest he*% There are other exkmples. 
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Parents support the (C£) ^ .program . ^ o 

Although some parents initially were skeptical of the program, fearing 
it might hinder their son or daughter's chamces af getting into 
college, all parents were very positive in their feelings about the 
programlby the second^ semester. They expressed positive appreciation 
of the program's experiential and practical orientation. They also 
reported positive changes in their son or daughter* s^J^ehavior. 
Evelyn's parents, for example, reported that she is roor^ considerate ^ 
and responsible as a result of the progrsun. Fred's writing ability 
has improved, according to his parents, and (CE) 2 has inspired and 
"self-propelled" him. ^ ^ 

The parents found the {CE)^ staff to be very open and willing to 
<|iscuss students' progress and difficulties wi^h the parents. 

Work values are being realized^^ developed and ch^ged as a result of 

Interaction with woi^king adults in the community and first-hand 
{and often first time) experience with work itself have helped 
students realize and develop their own work values. Cheryl began 
the progrcun with no work experience and no strong feelings about 
working. By mid-year, she expressed a view that work was only a 
meams to earning ^ney for purchases. By the end of her first year 
in the program, Cheryl expressed that a jdb for h^r "must be 
something (she) can get (iier/ personal satisfaction out of and tSiink 
that (she's) done sometning/' 

George rejected photography as a career because of the "uncertainty" 
of it as an income producer. He expressed a number of reasons for 
wanted to go into dentistry including: "The independence of the 
work, the money, the type of work itself, the need that it meets, 
the personal satisfaction it gives, the geographic < rea (h^) corula 
work in, and the job security." • , 

Fred's lifelong ambition to become a professional** musician is still 
his career goal, but is is tempered by a knowledge of the. economic 
realities., the need- for a "backup career'' and the possibility of 
con^romises that may need to be made. ^ 

Employer instructoTrs (EI) participate in EBCE at different levels of 
involvement . 

One of the aspects* of EBCE that makes it different from other career 
education programs is the shift of the control of the learning process 
from a professional educator to a community member, the employer 
instructor! Based op the experiences of the case study students, it 
can be concluded thatr EI's perceive and operationalize this learning- 
faqilitation role in widely different ways. 

One of Mike's El's took a personal interest in him, encouraged him, 
and helped develop both a^|etter self-image and more reliable work 
habits. George's EI at t"^hoto lab on the oth6r hand was often 
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late or '^^dn't show up and had not taken the time to inquire about 
George's interest in photography as a' potential career. Cheryl's 
EI. at the work activity center encouraged her to accept adult tasks 
normally asked of fbrofessionals* 

« *" 

Apparently, some El's see their role a? that of a resource from 
which students can obtain career information and job skills, while 
pthers take a more active role in helping the total student grow. 
Upon reflection, variations in expectations and performance may not ' 
differ, sujostantialiy from the variation within the teaching profession 

Students utilize community sites with differeht levels of involvement . 

To describe what students "do" at employer sites with a single general 
^statement is no more accurate than a single description of employer 
involvement? Some student? work, and ^^^^pt i^j^ responsibility at * 
the employer site (e.g., Cheryl At the yfdrk activity centjer) while 
others play an observer's role (e.g.-^red at the police department) . 
Not all use of en^)loyer sites can bi^escribed as positi /e however. 
Bpb described being "bumped arodft^ and "bored to death" at some job 
sites. ^ • . * 

" Few {CE)9 students have mafle a lifetime career choice . 

To assume that students have made a career choice by junior or senior 
year in high schobl ^d can work to prepare themselves for that career 
IS in contradiction to the evidence presented in the case studies. 
Two of the seven case study students (Mike and Fred) retained the 
setBie career goal with slight modifications over the course of the year 
All the other students fluctuated in their career goals, with some 
changing dramatically. Evelyn's goals changed from being a dental 
as^i^tant to being a veterinarian's assistant, bob expressed aii 
interest in auto repair, operation of a f<x>d cpoperative, and fir^ally 
the occupation of '^powderman. " George found his interest swing from 
professional photography to* dentistry. This information seems t5 
suppcM^t the hypothesis that many high school students are not yet*' 
ffeady to make an informed (and relatively pfermanent) career choice. 

St^dgnts learn from direct experience . 

One of the tenets of the ^BCE program is that experiential learning 
will benefit studer.ts in unique and pifactical ways. The effects of 
experiential learning are very difficult to measure and document, 
but can be seen anecdotally in the case studies. Evelyn relates very 
graphically how her first-hand experience with "green teeth" made her 
decide that dentistry was not for her. Bob found tnat the dirt "and 
pressure of the production line^ was more than he could handle. Feed's 
experience with the police department was a "hands on" lesson in 
interpersonal relations aind Greg attribjates his increased sense of 
responsibility tq^ (CE) experiences which made him see the results of 
his" actions.' 
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8 . The (CE)^ program is an individualized^ integratedi community-pased 
f ^rogram which en^hasizes e'^ep^iential learning . 

One of the purposes of the case study was to help provide an empirical 
definition of the (CB^'^ Program, An inspection of the activities and 
comments of the caaeN^tucJ^ students supports the program^'s self- 
description as an iV^i^idualized, integrated, community-based program 
and that experiential learning is it's prime focus. 



ERLC 



1.17 



106 



3 



CHAPTER IV, EV/VLOATION OF IMPLEMENTATION ACTIVITIES 




This 'section of the report summarizes the evaluation data collected on 
the implementation activities at NW^.:]L. Included in this section are: 
(a) an external evaluation of Project TOTAL (an EBCE program based on 
(CE)^ and operational for one year in Hillsboro, Oregon): (b) a summary 
Of reactions and perceptions of sites which used selected EBCE materials 
this year, (c) an evaluation of ii|plementation training workshops, and 
(d) evaluation data on^'the ©verall implementation strategies and planning. 
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Section A, External Evaluation Of TOTAL OPPORTUNITIES 
' THROUGH ACTION LEi&NINq (TOTAL) , 



Introduction 



This section ^fenmarizes the evaluation of the Total Opportunities Through 
Action Teaming (TOT/IL) program by the evaluation staff of the 
Experience-Based Careeir^lducation (EBCE) program, Northwest Regional 
Educational -Laboratory (NWREL) , Portland, Oregon. The NWREL evaluators 
were retained as external evaluators to (a) verify cost data on the IXXTAL 
program, (b) verify student change data and (c) provide alternative^ 
interpretations to TOTAL'S own internal evaluation data. 

Audiences fat this evaluation include the staff of the TOTAI^ program, 
Hill^oro school distriqt: personnel ^d members of .the community at large 
interested in the EBCE concept. 

Program Description ' » 

lOTAL is a'pilot alternative education program which uas devfelope.l r^o 
help students who have not succeeded cmd progressed in the regular 
school programs. TOTALTWas partly funded JDy special vocational education 
money for disadvantaged students and partly by the HillsLoro Union High 
School District. 

The first year of the TOTAL program was' spent developing and testing an 
individual learning management system with emphasis 'on vocation.al and iif^ 
^ills. A special .learning management teeun consisting -of a learning 
manager, community coordinator, student coordinator and peer aides 
helped each student select and con^Xete those learning objectives and 
activities which were best .suited to the interest and ability of each 
student^ in the program. During the first year th6 -primary goal was to 
develop the learning management; ^jstem and therefore the enrollment was 
limited to a maximum of thirty (30) students. . i 

As an alternative education program TOTAL focuses on learning through ' / . 
real occupational experiences in the working community. Reading, writing, 
comimattiicating, computing, coping, choosing and working skills are acquired 
through experiences in a wide variety of occupational situations. The 
outcome is up to the students. He or she may utilize these leaning 
opportunities primarily to identify and prepare for an occupational area 
of his/her choice or additionally to acquire basic learning skills and 
the important personal ^nd social skills needed in today's society. 

During its firpt several years of development and trial, TOTAL will serve^ 
those students- who^ have become disadvantaged to the extent that they are 
not able to ultimately succeed in the regular 'school programs. 
Eventually, however, the TOTAL program with its" individualized learning 
management, comunity-based learning by doing, and competency goals may 
become an a-'ternative avenue for learning available to any interested- 
student . 
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The TOTAL progra:m is, based primarily on the £BCE concept piloted by 
four regional^ educational research laboratories under the auspices and 
funding of the National lostitute of Education (NIE) . Most of the 
materials and strategies employed in the TOTAL program were adopted or 
adapted from the Community ExF>eriejices for Careet Edu( ation, (CE)2# as \ 
Hieveloped and directed in Tigard, Oregon by NWREL* The (CE)2 pfograrTi is 
' intended for juniors and seniors in high schoqjf. while TOTAL pnrollod 
primarily ninth and tenth graders. 

The TOTAL program reflects, the basic characteristics of EBCET: 

• The Community is the Classroom 

Learning is not confined to the classroom. Rather, it ta]ces 
place at a yariety of sites in ♦'.he community, including 
school. The emphasis as on Life Careers Education utilizing 
employer-based activities in the greater Hilisboro area:^ 

o Instruction is Individualized ^ , 

ft ^ Instead of offering tha same JLelrnina experiences for all ' 

students;, in^ruction is tailor-mad 3 to' the needs, intelrests 
and learning 'styles of each student. Initially/ individual 
learning {goals are designed for'each student through a process 
of negotiation involving the student, the commvmity coordinator 
and the learning manager with parental ap|)rovai. As the student 
begins a learning experience at each en^loyer site*; his field 
instructor at the site also identifies, areas in^which growth 
^ ^ for the student ^an and should occur, euid an individualized ^ 
program is written for him or her. However, the concept of 
individualized instruction does not preclude group learning 
activities. a ' , 

# Students Learn by Doing 

Students learn actively rathe-t than passively. While 
^participating on employer sites; they have an opportunity to 
.relate academic concepts to world of work activities, gain 
valuable experience in a variety of occupations and careers, 
and develop some entry level job skills • 
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The Curriculum is Performance Based 

Students are required to demonstrate competencies appropriate 
to their individual programs in a variety of skill and knowledge 
areas. Criteria for measureipent of learning growth are derived 
primarily from realistic community standards cmd self-set 
student goals. 

Learning is Interrelated 

Ins*truction is not compartmentali'zed into "subjects" chat are 
learned separately. Instead, the student's learning program 
is designed to allow him to gain knowledge in a variety of 
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disciplines at one time. For example, a student assigned to an 
emplbyer site may gain learning credit in math as applied to 
tools, measurements and estimations; English necessary for » 
writing required reports'; critical thinking as part of solving 
job-related problems; science necessary for understanding basic 
principles of electricity; communications skills while 
interacting as 'a member of a work team; and specific electrician's 
skills in order to help install conduit at the plant. 

* V * * 

Evaluation Design » 

.'Three different strategies were employed in the excernaL evaluation of the 
TOTAL program. 

A cost verification of the fiscaJL records of the program was , conducted by 
a NWREL^ evaluator who met with the TOTAL director and reviewed the 1974-75 
budget and record of expenditures. - A, summary of the review is included in 
this report. 

• ^ * 

Program effects on students were documented by an analysis o5. measures/ of 
stu<Jent ability and student* attitudes. D^ta were collected by the ToAl 
staff and scored and analyzed by'NWREL evaluators. Student baseline data 
are reported here and limited data on student ciiange are discussed. No 
data were cpllected from control or comparison group students, although 
comparisons of some baseline data were laade with data from tjie evaluation - • 
of .the Community Experiences for Career Education, (CE)2# program operated 
through NWREL in the Tigard School 'District. 

Student, staff 'and employer perceptions were^ collected. the NWREL' ^ 
evaluators by means of staff questionnaire^ and interviews »and by roecins 
of questionnaires and an interview with a random sair^le of student s.^ Staffs 
questionnaires focused on a description of how the TOTAL program operated • 
this year and served as a first step in the development of the interview.. 
The interview focused on staff perceptions of program effectiveness and the 
effectiveness of various learning strategies. It. also elicited fr©m the 
staff their perceptions of what factors facilitated or hindered the startup 
of the TOTAL program^ Student questionnaires focused on, their perceptions 
of varioijs learning strategies and the employer questionnaire dealt with- 
the usefulness of the Learning Site Analysis Form. 

Results , ^ ' 

Cost Studjr Verifications . On July 3, 1975, the external evaluator. met * ' 
with the project director of TOTAL to review the 1974-75 budget and record 
of expenditures. Support records examined were those .from the state 
grant of ^17,000 shown as Fund 20 and local district funds for the project 
consisting pf $26,473 ighown as Fund 1. Adequate documentation was on file 
in the director •s binder for all expenditures recorded except for the 
extended Contracts of two teachers prior to the beginning of the school 
year, since some expenses occurred after May 30, which was the date of 
the last budget printout by the district, it is not possible at this 
time to state wh^t the^ actual total operating costs were for project 
TOTAL this year, but the project director estimated it would be clq^e to 
the budge ted> amount. The projec;t director indicated that the district , 
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will t>e starting *a modified PPBS accounting system for next yaar which, > 
he felt, would make his budget accounting more, efficient. 

^ Student Outcome Ar^^ysis . Pretest assessment of all incoming TOTAL 
students was conducted on each student as' he/she entered the program. 
Since students entered the program in increments throughout the year, 
pretest data were collected at six different time points. The data 
^^ummarized here are from: (a) the Comprehensive Test of Basic Skills 
^ (C^BS) , which measures student vachievement in Reading, Language Skills, 
Arithmetic and Stuay 'Skills; (bN the Psychosocial Maturity Scale (PSM) , 
'which measures studfent development on nine -psychosocial scales of maturity 
ucilizing se^^f-report; and (c) a semantic differential type of instniment 
which meaiiures student attitudes towa^rd seven concepts deemed iit^ortant , 
for a young adult enterinfg the world'of work. 

Baseline Data 

Only the CTBS scores of those students , who entered the program prior to 
^,the start of th,p second semester were to be included in the pre-post 
analysis. It was reasoned that to attempt to measure change in Basic 
Skills over a less than one semester time interval would not be 
meaningful. For this reason, Basic Skills baseline data are presented 
for only those students Who entered 'TOTAL pr^pr'to the start .of the 
second semester. 

• * * * 

Displayed in T*able 22 is a summary of the pretest Basic Skills data ^or 
stucjent-s ^in the *rpTAL program; - 
. ■ \ ^ c» * 

. Table 22 ^ ' 

SUMMARY OF C^BS BASELINE DATA 
^ FOR STUDENTS IN PROJECT TOTAL 



* ^ Score ^ 


Subtest 


Reading 


Language 


Arithmetic 


Study 
Skills 


Mean Standard Score 


541.0 


557,3 


383.8* 


562.3 


■■ 'r ' ■* • ' ' 

Standard Deviation 


109.7 


86.3 


80.6 


108.3 


Grade .Equivalent 


'8.2 ' 


8.7 , 


4.3 


8.7, 



*^=16 



As cai)'b$ seen, the av^r^ge grade equivalent score for 'Reading, Language 
and Study Skilli^'is between''8.2 and 8.7. The Arithmetic score on the 
other hand is q^ite low (4.3). Part of this difference (between 
Arithmetic and other/ scores) may be attributed to sampling error. ' The 
Arithmetic subtest of the CTBS was not administered to students when the 
other subtests we^e administered Ijufe^was completed at a' later date. 
Consequeatly, some students ' (eleveift) were not tested in Arithmetic and 
the score reported here represents ooly^a subset of the TOTAL population. 
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Baseline data from the PSM are displayed in^ Table 23.- Again, only dataK 
from those students who entered the program prior to the second semester 
are summarised. Also di^pl-ayed in Tabl^ 2 3 is a pretest summary of PSM . 
data from students in the (CEO 2 program. Tji^^sfe comparative data ar^ 
mcii *^ed to pro\;^ide a nctrk against ' which to interpret the TOTAL scores, 
rather' than to compare the* TOTAL program With the JCE^2 program (they are 
'dealing Vith students f rom'^if ferent populatioiiS and age groups. 



The scores of students* in TOT^VL' are^ very S;imr!).ar to those of students in 
Jthe {CE)2 program on ^11 su^scales except Chang^ ^ On the Change 
scale ^TOT"AL Students on the average s<&ored 4.4 point's lower indicating a 
idwer degree of openness to change. - - ' . 



Tablfe'23 



SuMMi^y "^F P^M BA^ELIPIE DATA , 
, FOR .?rOTAL AND fCE)2 STUDENTS- 



J JL .... ' . .... 


■ .X- 






PgM SCALES ' 






1 * 




ff- 


c Group . 


Work 


Self -Reliance 


Identity 


Communication 


rH 


cn 
P 
u 


Social 
Cofcmitment 


u 

§ ■ 

• u 

rH 


Change 


Social 

Desirability 


TOT|LL X 


26.0 


28.7 


26.0 


23.0 


31.8 


25.5 


31.5 


35./ 


30.7 


20.5 


. (n=25) S* 


5.1R 


5.23 


4.61 


5.49 


4.44 


6.23 


5.17 


4,39 


4.09 


3.04 


,(CE)2 X 


29.2 


31.0 


29.6 


26.2. 


32.5 


28.5 


34.7. 


37.0 


35.1 


21.0 


(n-50) s 


5.09 i 


5.05 , 


5.46 


5.98 


3.94 


4.70 . 


^ 4.90 , 


4.72 


4.68 


3.45 



X is a symbol denoting the arithmetic mean, S is a symbol denoting 
the standard deviation 



The semantic differential pretest data are displayed in Table 24. 
fi^m the (CB)2 program in Tigard have also been displayed. 



Data 



TOTAL students ^pear t6 have a more negative attitude toward "school" upon 
'entering 'the program thau did the (CE)2 students. Other differences 

appear negligable. Both groups had relatively '^ositive attitudes toward 
^learning" and "work." 



123 



112 



^' , ' f T^LE 24 

SUMMARY THE SEM^IC QI/fERENTIAL 

DATA FOI? TOTAL AND^CEf^ STUDENTS 







Scale 


/ ^ Group 


V- 




School 


Adults 


Learning 


Work 


Decision 
Making 


Coiranunity 
Resources 


TOTAL 


X 


, 51,9 


38.3 


47.7 


52.5 


57.7 


47.0 


48.5 


(n=26) 


S 


6.84 


12.7 


9,0. 


12.2 


8.4 


7.8 


10.7 


(CE)2 


X 


55.1 


45.5 


51.9 


56.9 


57.6 


51.9 


51,5 


(n=50) 


s 


9.90 


13.0 


10.6 


8.7 


9.5 


10,8 


10% 6 ' 



0 



Previous high school grade point aVerages and attendemce data avail6d:>le 
on the seventeen students enrolled prior to December 9, 1974, indicate an 
average grade point average of 1.14. The average percent of time in 
attendance at school prior to entering TOTAL was 35.7 percent. 

Change Oat a ^ 

The CTBSr PSM emd semantic differential were» administered to students in 
the TOTAL program at the end of the first program year. Po$ttest data 
were not available on* all students however. Many students did not attend 
the testing session, and some ce^ts that were completed were invalid due 
to obviously systematically recorded answers. Thus the pre-post data* 
are from a small subset of the TOTAL ^population and all conclusions based 
on them would be tentative at best. 

Qecause of the paucity of posttest scores, and because some of the scores 
that are avail3t)le are so different from pretest scores as to suggest 
remdom guessing^ no pre-post nalysis was performed. Complete pre -post ^ 
CTBS data were available«on only eight 3tudent«, PSM data on ten students 
and semantic differential data on five students* The evaluators 
reason that the dangers of misinterpretation of these data far outweigh 
the benefits of presenting them and thus these data are not presented. 

Attendance data coriected during the first semester cmd reported in the 
TOTAL Interim Evaluation report indicate that the -*verage percent 
attendance during the first semester was 85.9 percent. During the 
second seinester the average attendance was 89.0 percent. 

Staff, Student and Enqployer Perceptions 

Staff Interviews . A semistructured interview was prepared and conducted 
by a NWREL evaluator with each of the four staff members of project 
TOTAL on June 4, 1975, as part of an external evaluation of the project: 
Each interview took approximately an hour. Questions on the interview 
covered the following areas: (a) staff perceptions on the extent to which 
TOTAL met its program goals and student learning ^goals, (b) the perceived 
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effectiveness of the various learning strategies used, (c) factors 'that 
facilitated or hindered the start up and implementation of TOTAL, 
(d) technical support desired and/or received from NWKEL, (e) activities 
in program/materials development, (f) the utilization of employer sites 
and (g) .plans for the coming year. In addition questions in these 
areas, t^e interviewer reviewed staff responses .on several recently 
completed questionaires dealing with the staff's use of the EBCE handbooks 
^nd the use of selected EBCE materials such as the student Exploration ' 
Package. Fie then asked some followup questions to clarify some of -these 
written questionnaire responses. c 

Because TOTAL staff members each have special areas of responsibility in 
the project, specific interview questions were directed primarily to the 
staff member considered to be the most familiar with that area. Broader 
questions were addressed to all staff-. 

Interview questions and paraphrased combined responses of the TOTAL staff 
are as follows: 

1. To what extent do you feel TOTAL was able to me.^t its program g oals 
of providing an interdisciplinary, individualized ^ experience -based 
program of learning utilizing the community as a primary learning 
resource? 

a . Interdi3ci|)l inary 

The integration of ba$ic reading and mathematics activities with 
projects has begun this year but muct) more work in thi5 area is 
needed next yearr Other subject areas have not yet been well 
integrated into the TOTAL program, 

b. Individualize d - ' 

The job site experiences of students in the project have been 
' • highly inciivi dualized and we have gotten off to a pretty good 
start .in individualizing activities, at the learning center. 
J Our instructional practices are individualized but we could do 

a better job if we had better materials for individualizing 
Basic Skills, 

c . Experience-based 

This is the strongest p^rt of the program. The employers have 
been particularly cooperative in providing learning experiences 
at ,their sites (one staff member recommended this aspect of 
the program for all ninth and tenth grade high school students) , 

' d . Community- centered 

This aspect of EBCE is working well but it is still being 
expanded. The staff are not only involving the employers and 
competency certifiers but are also working with the 20-30 Club 
in Hillsboro in developing an extra-curricular program for 
weekend activities for certain students from broken homes 
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tf> keep them off the street and give them interesting things to 
* do. At the school district 'board meeting in May at which the 
continued funding of project TOTAL was discussed, a number of 
parents and en5)loyers attended to speak on behalf of the proj^^rt 
The employer relations specialist indicated that she would like 
tio have had more help with clerical tasks so as to have been 
able to visit employer sites more frequently. 

Which student learning goals do you feel the TOTAL program was most 
effective in reaching? 

At the beginning of the year we had no idea how far the students 
would go. They seem to have made good progress in improving in 
their self-^concept and self-confidence. Their experiences at 30b 
sites have helped in these two areas. Gains perceived by other 
staff men±>ers includec*. improvement in Basic Skills for some stud'^'its, 
in dress and in relating to their peers. 

In what student learning goal areas do you feel the TOTAL program 
yas less successful than you had hoped? 

We need to get the basic skills objectives and materials better 
organized. The competencies and student accountability zones need 
to he refined. Students need help in becoming more self-directed. 
Somt' of the students dor 't always behave that well or show up at 
employer ^^tes when expected. 



- How effective do you feel the following learning strategies were 
this year in helping TOTAL 
on any of these strategies 

a. Competencies certif icatilon 



this year in helping TOTAL s^udencs? Please feel free to comment 



Not many competencies were certified this year, but those 
completed were highly useful and generally popular with 
students. The Newspaper and Checking Account competencies 
were very good. Others isuch as Driver Education and You and 
the Law are still under development. Some bf the high 
school department staff nave been 4ielping in the development 
of some competencies. The coittnunity resource -people have been 
very willing to certify tjhe competencies. 

Journals 

The journals were- regnire^l daily of all students toward the 
beginning of the school y^ar and did not work wel'l because 
students tended to merely ; report their job site schedules. 
Later in the year the joxiijnals were intended to be more open 
in content and required onily twice a week. This worked okay 
for awhile but gradually dropped off because the staff lacked 
time in teaching students Values clarification ideas and how 
to express feelings in wri|:ing. This area will be attended to 
next year. Later in the yiar journals , became optional and four 
or five students decided t<i> use them toi communicate thqir 
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feelings to the student coordinator. 



Exploration package 

T^iis has been highly useful but needs further development for 
next year. Students are required to complete them within a 
week in order to receive credit. Only 4 of 116 were not 
completed. Changes desired in the Exploration Package would make 
them more into a checklist fashion for students who are very 
poor in reading and writing. Also the guide for the student 
interview of an employer will have to, become more structured to 
work with some students. The staff will also be encouraging 
students to complete the exploration packages ythili^ actually 
on site rather them completing them at the learning center. 

Basi": Skills pr^ram 

The Noonan-Spradley Diagnostic Program of Computational Skills 
was used very effectively for diagnosis and prescription. The . 
learning manager developed work problems for individual 
students^ This was time consuming and he would like to consider 
using the IIjA materials next year f'f money is available for 
purchasing them. 



Employer led seminars 
Not used, ' . ' . 

Individual projects 

This* was highly useful to* studcats and got them moving. 

> 

Preprepared projects 

These were not used this year but will be next year. They will 
be used to: (a) to help insure that students achieve the Life 
Skills objectives, (b) to give students the opportunity to have 
a more specific structure to begin the year and (c) to lessen 
the demand for the learning manager's time in helping to plan 
4nd negotiate each individual project. The directions for the 
preprepared projects and for competencies may be tape recorded 
to help students. 



Tutors 

Four of the five paid high school' student tutors worked, very 
well with TOTAL students. The fifth did clerical work well. 
Several have volunteered to return next year as Basic Skills 
tutors even though they will not receive pay. 

Student maintained record file . » 

This was not implemented this year. Ne*t year it is hoped that 
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this will be developed as part of the overall student 
accoiintability system. 

4 . What were the primary dif f iculcies, if any, in starting project TOTAL 
in Hillsboiro? 

The nor^mal channels for starting up a new program— someone gets an ^ 
idea and writes a proposal, obtaining approval of the school ^ 
curriculum committee, followed by approval of the district curriculum 
committee, the superintendent and board — were not followed. Instead, 
the , district 's coordinator of career education attended a meeting of, 
the district's vic^e principals during which they coit5>lained cibout what 
to do with problem students. The career education coordinator 
suggested an EBCE type alternative program. The principals liked the 
idea and asked the coordinator to put together a proposal. The 
distj^ict board finally approved the* proposal after it had been 
approved by the state for funding. , 

* . ... . * 

Some counselors who referred problem students to the project didn't 
have cm adequate understanding of the purposes of the project. The 
TOTAL staff have continually explained the program to the 
administration, counselors and teachers to help them see the progrcun 
as* more than a "last resort." This spring the counsellors have gone 
to teachers to help recruit a wider variety of students into TOTAL 
for next year. As a result, it is felt that; the project, is changing 
its image from that of serving only students who are in trouble or 
those not succeediag in school to one of providing a more, practical 
and less academic approac|i to learning. - " ^ 

? 

5a. Wha t ^ types of tec hnical support from NWREL were used in implementing 
TOTAL this year ? 

Informal training was given by the replication team. The evaluation 
unit ha^ helped with the evaluation design, provided instruments and 
assisted in the data processing. They also provided help in <jjj^riting 
the evaluation report. The handbooks were also helpful although 
they were read and used primarily when the staff' came across problems. 
The' (CE)2 project director provi4ed some information and support in 
one problem encountered with a union. Visiting the (CE)2 project 
and getting information and forms from the employer relations 
sppcialist at {CE)2 were helpful. 

5b. Is there any type of NWREL help you would like to have for next^ year? 
If yes, what type? 

Yes, training on how to interpret the Self Directed Search scores apd 
the use of other data such as CTBS scores; an opportunity to visit 
(CE)2 while they are working with students; help in exploring new 
staffing patterns; access to materials including a copy' of the (CE)2 
•student portfolio, the new handbooks and copies of brochures or 
other literature given to employers by (CD 2 or other replication 
sites; and information about crareer guidance and counseling. 
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6a, Approximately what proportion of your time and ene^^v was spent on 

pjTogram/materials development since the beginning of the school year? 

Project director — 0, community resources coord in* tor — 30-35 percent, 
student coordinator — 10-15 percent, learning man6.ger — 20-25 percent. 



6b, 



Did this time spent on development interfere with^your work with 
students? 



"All three staff spending time on development ^id yes. 

6c, y yhat materials/activities were especially time consuming to develop? 

Student progress report forms, the revised exploration package, 
translation of student experiences into school credit, letters and 
materials to employers, en^loyer certificates, certificates of 
company participation, bus- scheduling forms, forms to record student 
data, Basic Skills materials, 

6d, Will less time be spent on development next year? 

All three staff said yes, 

7. What factors, if any, have you seen this year that jcontributed in a 



major way to the success of the TOTAL program , ^ 

The staff art interested in students eind enjoy their jobs. There is 
good » cooperation among the staff, even under stress, and a good 
exchange of ideas. There is respect^ for the project director. The 
cpmmunity and school support has helped. The availability of the 
EBCE design from which to adapt has been an imp6i;tant factor. 

What obstacles, if amy, have you seen this year that ha^ limited 
the success of the program ? 

One staff member saw no obstacles and felt the project had a lot of 
freedom in its operation. The other ^taff cited the following, 
obstacles: inadequate bus transportation for students, a lac)^ of " 
money for materials such as the ILA Basic Skills materials, the lack 
of adequate secretarial support for th^ -^taf f , the large proportion 
^ of problem students in the prograun wnich has t2dcen a large amount 

of staff time and the lack of adequate time for the community 
coordinator to visit en^loyer sites, ; 

The following questions were asked of only a single TOTAL staff member, 
usually the one pe rceived by the interviewer to being most directly 
involved with the content of the question. 

• 

^- Approximately how many students are expected in the program next year 
and what ^re the criteria J:>eing used in selecting these students ? 

Approximately 60 students will be in the program next year. The 
staff "are interested in changing the image of the program from that 

ERIC 



of being a dropout program to that of being a comprehensive careec^ 

education program that could benef it_ a variety . of students includ»ig 

those who may be average or above average in abilifjH&ut are not 

achieving their full potential in the regular school prograon. The. 

staff are interested trying to attract a-^few students who would 

be in the project on a half-time basis ^nd who would spend the 

remaining time in the regular high school program. 

10. If you were to predict way6 in which^ four years from now, students 

• who had graduated from TOTAL would be different from a control group 
' of similar students who did not participate in TOTAL, how would the 
TOTAL students be different? 

TOTAL students would probcU3ly have greater career planning skills, 
be more self-confident in their career choices and be better at self- 
management (of their time and priorities) . 

11. Do you have any plans, for modifying staff roles for next year? If 
yes, what changes do you plan? 

We will be operating with the same staff with the addition of a 
full-time aide. Hie a school tutors will not be paid but we hope t> 
use volunteers. . * 

12. Do you feel that the number and' variety of employer sites has been 
adequate for student jplaceroent this year? If no, what changes would 
you like to make ? " ^ ' 

TOTAL used 110 employer instructors at 54 employer site^.this ye^r. - 
The community coordinator would like to double that nuirber for next 
year. District bus transportation limited the sites usually to 
those in the Hillsboro District. The numl^r and variety of employet 
sites seemed adequate this year and the only occupational exploration 
ifequests by a student this year that couldn't, be met was the career 
of modeling.* jj 

13. . What types of activities were carried on this year to develop and^ 

maintain effective employer sites? 

Informal visits to employer sites were made by the community 
coordinator and brochures and humorous posters given to them. Much 
of the contact with employers was by phone. Information 2d>out the 
present activities of students who had visited an employer site 
previously was given to the employers when the community coordinator 
talked with them* - Thank you notes and lunches were also used to 
maintain the employers' spirits. .During the entire year, only two 
students were asked by their eirqploVer instructors not to return and 
five students were ccmcelled at en^loyar sites by the cornnunity 
coordinator usually for failure to show up at' the sites. 
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Student Perceptions 

Questionnaires to measure student perceptions of the student journal as a 
learning tool were administered to a seunple ^pf eight TOTAL students. 
Student opinions about the usefulness of the journal were vjry mixed. 
They liked most the opportunity the journal^ afforded to express themselves 
and "say anything you want to." The most disliked aspect of writing the 
journal involved the tedium and reported boredom of much writing. 

Ten students were asked to respond to a questionnaire on the use of the 
Exploration Package as a learning tool. As with the response to the 
journal questionnaire, student responses to the usefulness of the 
Exploration Package were mixed. The chief complaint a^ut the package 
invojved the time and energy required to complete this additional paper 
work. 

m 

A structured interview was prepared and administered by a NWREL evaluator 
to a random sample of six of the project TOTAL students who had been in 
the program since at least January 1975. The faterviews were held on May 
21 and lasted approximately 25 minutes each. Students interviewed were 
assured that the individual identification of their responses would be 
kept confidential and that only a summary of responses from all six 
students would be reported. Questions on tlie interviews covered the 
following areas: (a) program individualization and student c^loice; 
(b)' resources used by students; fc) estimated time spent on| t^e learning 
center and at employer sites; (d) degree of student involvero^i in activitid^s 
at the employer sites; (e) perc?eived response of students, par^ts and 
employers to>rar?l the program; (f ) comparison of the project v^i^h the regular 
high. school program; and (h) the influence of the program on career decision 
making. Of the six students interviewed, four were boys and two were girls. 
Three of the students were ninth graders, two were tenth graders and one 
was a senior. 

The purposes for the student interviews were: (a) to verify student 
questionnaire findings and (b) to obtain insights into some additional areas 
of student opinion about TOTAL that were considered relevant by the^ 
external evaluator. In line with the first purpose identified, many of 
the interview questions are similar to those reported on the studertt 
questionnaire! 

Each of the students interviewed felt that the project staff knew of their 
interests and the students were able to cite some TOTAL activities that 
were of personal interest to thfem. Only two of the six students felt that 
they had been asked to do activities sometimes that were too easy for them 
and none felt the activities were too difficult for them. All six students 
felt that they had a choice in selecting activities in the TOTAL project. 

At employer sites all six students felt they were getting a:3equate feedback 
on their performance and five of .the six felt that the amount of feedback 
froin the TOTAL staff was adequate. Learning resources used by students 
included the school library, materials at the employer sites and help from 
en^loyers and staff. The nature of student activities at en^loyer sites 
was one of direct participation rather tfhan merely observing others at work. 
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In- the perception of the students, the TOTAL project was being viewed 
favorably by both the participating employers and by their parents. If 
they had to do it over again, five of the six students said they would 
definitely have joined TOTAL and the sixth student w^s not sure. Among 
the strengths of the project most frequently mentioned by the students 
were: (a) the helpfulness of the staff, (b) the more relswced atmosphere, 
(c) t^e freedom to learn what you yant and at ycur own speed, and (d) 
the opportunity to learn about jobs. The only weakness cited by more 
than one student was insufficient transportation to en4>loyer sites outside 
of the Hillsboro area. 

Two of the six students felt that TOTAL had helped them to select a career 
that they wished to follow and the remaining four found it useful in 
exploring jobs to be able to identify certain occupations that were 
definitely not for them. 

The findings from this interview of a random saraPle of TOTAL students are 
considered by the external evaluator as highly .consistent with the 
findings of the student questionnaire which was designed, administered 
and analyzed by project staff. 

Employer Perceptions" 

Ten .participating employers were asked to, fill out a questionnaire on the 
use and "Effectiveness of ^he Learning Site Analysis Form (LSAF) . All ten 
of the respondents reported that the information recorded by the LSAF 
coincided with their perceptions of the learning ^tential of their site. 
Two employers reported that the LSAF helped them become more aware of the 
learning potential of their site. Only^ onr employer reported that the 
L^;^ had po effect on 4iis/her business. Effects of the LSAF reported 
included: 

"It has changed the way I .deal with students." 
"It. has changed employee training and education efforts." 
"It has changed the company's self*image as a community learning 
resource." 

"It has suggested changes in the company's hiring practices." 
Sunmary 

Program Characteristics . The TOTAL program can be characterized as a 
' • true experience'-based career education program. Although its focus during 

the first year of operation was not on a cross*3ection of students, the 
program did provide an individualized, -integrated educational experience 
based primarily on "iiands on" experiences in the comrnvinity and the "real 
world" of work. 

The progreun was initiated by the district director of career education 
and was implemented without undue difficulty. Staff members report havinq 
spent from 10 to 33 percent of their time during the first year on program 
development activities but expect to spend much more time on operations 
next year. Some difficulties were encountered in getting away from the 
"last* resort" image apparently held by some high school personnel, but 
relationships with employer and the community at large appear to be quite 
good. 
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student baseline data indicate somewhat below average achievement by 
entering TOTAL students on basic sl«Llls and grade point averages. 
Affective measures indicate that the /attitudes of entering TOTAL students 
are very similar to students entering the (CE)^ program. ♦ 

Student Outcomes . Attempts to measure program effects on students with 
pre-post measures were unsuccessful due to the phase^ in of new students 
at different times throughout the year and to poor attendance and student 
attitude at the posttesting session. Very sparse posttest data were 
collected and no attempts were made to estiiijate overall student' change on 
either the cognitive or affective dimensions. 

A very dramatic change which could be attributed to the TOTAL program is 
the change in student attendance^. During the 197 3-- 74 school year the 
average attendance was 35,7 percent. During the first and second 
semester in TOTAL, it jumped' to 87.5 percent. ' 

Program Strengths . The staff of the TOTAL program appear to the evaluators 
to be interested in the students and to enjoy their work*. The studeots of 
TOTAL share this jperception , and report that the freedom to learn what 
they are interested in without the pressures associated with the regular 
high school program are additional strengths. Good community and school 
sup^r\ were also reported by the program stafi. 

The evaluators have observed, and interview data appear to confirm, a 
very positive attitude toward TOTAL on the part of students / staff and 
employers. This attitude may be both a factor in the progreun's success 
and an outcome of that success. 

Program WecJcn6sses . Two of, six students interviewed and one staff member 
reported that inadequate bus transportation was an obstacle^ whidh limitQi* 
the success of the TOTAL program. Another weakness cited^ by a staff 
member and confirmed by at least one student involved the lack of staff 
time due to the extra attention demanded by this particular stydent qro.up 
and by the paucity of clerical help. More staff time is also needed to 
adequately visit and maintain employer sites. ^ 

Recommendations 

<■ 

Based on the information collected by the NWREL evaluators and reported , 
here, the following recommendations are offered: ' 

1. A more reliable testing program should be initiated. By pretesting 
all entering students early in the fall and by scheduling the 
posttest before "spring tever" has rendered students unwilling to 
participate, program effects might be documented. It is also 
recommended that students be reminded of the importance of the 
* testing in the evaluation of the program as this may increase their 
willingness to cooperate. 
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The TOTA^ otaff arq encouraged to follow through on their plans to 
^tape reyfcord directions for each con^etency in order to clarify 
directions for students who are poor readers- This- woruld be 
beneficial to those students who reported difficulty understanding 
what -is expected of them. 

We encourage TOTAL to go ahead with plans to use the preprepared ' 
pro3ects next year to increase the likelihood that studen-ts will 
achieve the life skills objectives and to help reduce the workload 
on the staff. We^ feel the latter will be a necessity, especially 
with the enrollment of additional students next year. 

Finally, we recommend the continued support of the TOTAL program by 
the Hillsboro School District and by the Hillsboro community. 
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Section B, Evaluatigm of Sites Using Selected EBCE Materials 



Questionnaires were sent to project diredtors in five school districts in 
the Pacific Northwest which had used selected 'EBCE materials in FY 75. 
Four of the five returned all the questionnaires. A tabulation of the 
responses is included in Appendix N. Summarized below are user rq^ctions 
to EBCE rrtaterials. 

EBCE User Handbooks 

Staff members at the four ^ites reported that the Handbooks were complete 
and easy to use. One respo.ndent commented that in some areas the language 
borders, on jargon while, another 'expressed the need ^foj; a short concise 
overview. All respondents felt thpy understood the EBCE philosophy. 

Exploration Package * w 

Three of the four sites used the Exploration Package as it Was^ developed 
at (CE)2- ThW fourth district is in the process of revising it to 
accommodate poor readers. St^ff members described as positive the effect 
of the Exploration Package as a vehicle to get stude^nts to pinpoint their 
interests and think about their values. Students described the positive 
aspects of the Exploration Package in terms of its assistance in helping 
them explore /different aspe*cts of career^ and as-a refcord of thAr 
experiences.! They expressed a dislike ^or the amount oT time and writing 
activity denjaaded by this process. ' C ' 

Student Journal ' • ' ^• 

The Student! Journal was used by two sifes. Staff frpnv one site regarded 
the Joumalias an effective' tool to establish trust and calling between 
staff and students, Striff member's from the other site were more' reserved 
in. their praise, indicrting only that the Journal had a positive effect 
on those stfudents who used it as a communication device. Both sites plan 
to use the/ Journal again next year. Students liked the opportunity to ^ 
express -themselves €o the staff, but as Vith the Exploration Package, 
repbrfced that it required too much time and writing. 

Learning Site Analysis Form (LSAF) 

The Learning Site Analysis Form was utilized by three school districts 
to analyze approximately SOjcommunity sires for their learning ^potential. 
One site revised the LSAF to make it more easily understood by employe^rsr^ 
All enployers surveyed felt they unde«rstood the purpose of the LSAF and 
that the information collected by it coincided with their percept-ions of , 
^he learning potential of their site. They report that the LSSF has 
both changed the way they deal with students and has changed their ^ 
employee training/education efforts. 
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Section C, Evaluation Of Implementation Trailing Workshops 

" — - - ^- 

\ 

In March, 1975, the first week long EBCE training worl^shop was held in 
Ti^ard. Eight participants, representing four districts planning for the 
implementation of EBCE in the fall of 1975, 'attended the workshop.' -Topics 
discussed ^t the workshop included: the philosophy of EBCE, implementation 
issues, and the use of the various EBCE assessment and learning strategies. 

A questionnaire was administered to all participants at the closfe of tha . 
workshop asking for their perceptions of tne workshop and. a self-rating of 
their knowledge of (CE)2 androf their ability to take steps to set up an • 
EBCE progr£un. A tabul,^tion of responses to this' questionnafire is contained 
in Appendix K. ' ' 



The workshop parti,cipants contributed many worthwhile suggestions which 
tan be used tQ modify future workshops. Even with their diverse backgrounds 
and previous understanding of (CE)2, they rated the workshop high. Thes^ 
participants felt they were well prepared to. represent the (CE) 2 program j ^ 
to student)6, parents and employers? were able to'coir^lete the preliminary 

^ implementation planning phasoi; and, were able to complete the prograun 
start-up planning strategies. These participants also rate<^ theiif^ 
understanding of (CE)2 concepts quite highly r4nging ftom a low mean of 4.00 
(on a 5-point* Scale) for /I'good understanding or .both the career assessment 
procedures and application of t^ LSAF ^to^ a high mfean rating of 4.88 for a 
very good understanding of bot-lfif^^the bas*xc EBCE philosophy and the importance 

' of the student negotiating process. . 

summary the workshop appears to have been well planned and executed ^ 
and appears to^ have ac^on^lished its purpose. 
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Se ction D. Evaluation Of Implementation Strategies And Planning 



Introduction 

/ 

In order to synthesize the insights and knowledge gained from the EBCJE 
rePlir^aticr. cxperiencti^ this year^ a set of questions was developed by the 
evaluation unit in June to focus the findings. The first draft of 
questions ^as reviewed and critiqued by the project: director and 
coordinator of the implementation unit. Additional questions were added, 
others changed or omitted, and a priority of iir^rtance was established 
within the revised "questions. Based upon this list of revised questions 
an evaluation design was constructed that indicated the sources of data 
to be used in answering each question and procedures for obtaining and 
analyzing s^ch datci. The results of implementing this evaluation design 
are contained in this section of the evaluation report. Eaph question is 
stated together with a summa^ of findings. Although it is felt that this 
section of the report contains information of^ special interest to pc*-.ential 
EBCE adoptors, several limitations should be k6pt in fiind. First, the 
implementation questions listed here were generated at the end of the 
school year rather than at the start of the in^lementation activities 
and thus adequate time was not availeibl6 for collecting extensive data. 
Second, some of the answers provided to these questions are based v the 
opinions and experiences of only several persons involved in KWREL*^ 
implementation efforts. Third, some df the questions covered in this 
section of the report CcUi only be answered adequately during the coming 
year after more experiences have occurred at various pilot sites. 
Despite these limitations, the experiences gained from the first year of 
implementation activities needs to be documented and communicated to 
others in a timely manner. 

1. What are the characteristics erf EBCE pilot sites for FY 76? 

Data describing^ EBCE related activities , at pilot sites in FY 75, 
plans for FY 76 and NWREL staff observations were organized by the y 
EBCE implementation tfiaip. at NWREL. These data are presented in 
Appendix M for Billings, Montana; Colville, Washington; Hillsboro, 
Oregon; Kennewick, Washington; and Kof'j.ak, Alaska. Data are 
organized by 1974-75 actions, 1975-76 plans and observations by the 
NWREL EBCE implementation staff. 

/ 

2 . What uses and modifications have been made of EBCE materials or 
procedures this year by implementation sitec? # ' 

A description of the use and modification of EBCE materials^' 
reported previously in Section B of this chapter. Tabulated 
responses to evaluation questionnaires regarding the use of materials 
is displayed in Appendix N. 



/ 
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3. What are the important steps and sequences needed in introducing and 
implementing EBCE in a school "district ? 

An "ideal" timeline was developed by the EBCE in^)lementation team in 
conjunction with the USOE Vocational Education Act, Part D 
demonstration activities. This timeline is based in part on USOE 
re'quirements and deadlines for proposal submission , but is based 
priia^'irily on replication experiences in FY 75. A chart of this 
timeline, together with a description of USOE, LEA and NWREL events 
is reproduced on the next page. 

-4 . What are the advantages and disadvantages of a district using an 
EBCE implementation strategy that starts with the use of selected 
EBCE materials and then proceeds to move into the total model? 

An interview with two members of the EBCE implementation unit revealed 
two important advantages to this approach. First, it bypasses the 
many decisions and approvals necessary to adopt a new program in a 
school district. Because of this, materials can be "added onto" or 
substituted for existing curriculum materials and strategies with a 
minimum amount of strain on the system. Second, and related. to the 
first reason, incremented change is easier to bring abouti, than 
radical change. Given an opportunity to try new materials and 
strategies in a small way, people are then informed to make a decision 
about more full-scale adoption. 

The only disadvantage cite'd by the implementation unit iivembers 
involved a possible loss of time in producing change by going via 
this less direct route. 

5 . What configurations of EBCE materials or sti a tegies are most 
frequently requested ? 

To date, only five replication sites have actuc;ily used EBCE materials 
and learning strategies. No patterns of use or popularity of learning 
strategies are noted across these sites. More conclusive information 
on this question v;ill be availcible as more sites request EBCE 
materials 4n FY f6. 

6. What are the anticipated costs of operating EBCE in full model sites? 

Since cost is an inevitable consideration in the in^lementation of 
any new educational program, it follows that districts are interested 
in the cost of implementing NWREL' s version of EBCE.*' 

During the past year, NWREL has worked with several districts which 
have c^'eveloped program budget^ for EBCE implementation in the fall of 
1975. Tcible 25 summarizes projected costs for five of these proposed 
EBCE programs. 



Coc^ data presented here we ye collected and analyzed by the EBCE 
implementation unit and were supplied by Robert Gourley, coordinator 
of the cost study effort. 
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Planning for NWREL EBCE Implementation 




iiSOE ACTIVITUS 

JUMrd EBCE planning 
grants 

tmcmi-vm local 
li^Uaintation proposals 

Mtmrd grants for 
lnvlaaantation 



tHla llif>leMntation 
tlMlin* lilts key 
activltiaa in preparing 
to oparata an EBCE 
pngrm. Nina ao^tha of 
"U«d tlaa- is 
mi99astad as tha 
■^nf— ■ tiaa pariod 
MfoMMry to sat ir> an 
OCB proqtm. Datails 
OB activitiss can ba 
fovid in tha uaar 
^andbooka davalopad by 
MVL. Inforaation 
About training sassions 
i» alao avai labia froa 



LOCAL EDUCATION AGENCY ACTIVITIES 



3. 

4. 

5. 
6. 

7. 

B. 

9. 
10. 
11 
12 
13 
14 
IS 



Attend EBCE awaranass prasan tat ions 

Prepare EBCE infomation natarials 

b«lect and orient planning group 

Attend HmEL training aassion 

ronduct survay of cc —unity interest 

Prspare first draft budget and staffing 
plan 

Begin presentations to )tsy groups 
sacurs initial aaployer cooMLitaants 
□•vignate support systaa needs 
Prepatt. curriculua design 
Design student racruitaant prooadurss 
Prapars evaluation design 
Prspare overall aanagaaant pien 
Prapara final budget and staffing plan 
Sec ore planning group approval of total 



17. Secure state agency approval 

18. Sutelt proposal to USOE 

19. Establish formal jKlvisory group 

20. Select staff 

21. Select students 

22. Select CBCE facility 

23. Orient n«w staff 

24. Begin signup for specific e^loyer 
sites 

25. Occupy EBCE facility 

26. Attand MfREL training session 

27. rinalixa curriculua daliwry ayataa 
26. Eatablish student aarvicas systaa 

Pinalixe aanagaaant systaa 



pljm 

Sacure school board approval 



29 

30. Obtain/print suppliss. aatarials^ 
'onM 

31. Begin prograa 



(fUREL ACTIVITIES 



1. Conduct regional at'ar^ ^ss sessions 

2. Operate teleplvone assistance network 

3. Conduct planning training sassicxi 
(3 days) 

4. Conduct planning training aession 
(3 days) 

5. Conduct planning training aassion 
(3 days) 

6. Provide local agaiicy technical 
aasistance 

7. Conduct iiv>leaantation training 
aassion (S days) 

0. Prorlds local agency technical 
aaaistanoa 

9. Conduct ij^leaentation training 
aasalon ('< days) 
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Table AS 

CfeCK PROGRAM BUDGET ' SUMMARY FOR FIVE 
V >^HPi.ICAT10N SITES FQR I'Y 



Ete scrip t;L on 


District 

i 


District 
2 


District 
3 


District 


District 
S 


Salaries 


23,-^0 * 


40,600 


Ii9,100 


25,^00 , 


139. goo 


Personnel Benefits' 


2,300 


1*,100 


U,900 


2,500 


13,100 


Consultants 




- 


- 


- 




Other Personnel 


- ^ 


- 


- 




- 


Ttavel, Staff 


500 


- 


350 


1,500 


2.500 


Travel, Consultants 


- 


- 


- 


- 


- 


Travel, Students 


- 


- 


U,900 


1,000 


h,000 


Transportation of Materials 


— 


- 


100 


- 


* 500 


Facility Rental 


- 


2,000 


- 


- 


9,000' 


Equipment Rental 




- 




- 


1,000 


Telephone 


— 


— 


270 


— 


300 


Utilities 


- 


— 


- 


- 


1,200 


Duplication 


— 


500 V 


200 


1,000 


1,000 


Data Processing 


- 


- 


- 


- 




Subcontracts and Agreements ^ 






3,200 


500 




Conference Expenses 


_ 











Other Services 




500 








Office Supplies 


500 


800 


590 


uoo 


■■ 500 


Printed Materials 


1,000 


500 


" 690 


800 


^OOQ 


Other toterials 


800 










Program Equipment 


1,500 


3,500 


1,700 


1,000 


2,000 


Office Equipment 










1,000 , 


TOTAL 


30,000 


52,500 . 


66,000 

_.. _ .f 


3^^,200 


170,000 



Insurance, van leane, etc. 



1 



Table 26 



EBCE PROJECTED 1975-76 BUDGETS 



District 


Projected 


Projected 


Projected 




Annual 


No. of 


Annual 




Budget 


Students ^ 


Cost/Student 


.---'^""^ 1 


$ 30,000 


30'" 


$1,000 


2 


52,500 


50 


1,050 


~ — ■ ? '— 

3 


66,000 


60 


l,iOO 


4 


34,000 


25 


1, 370 


5 


170,000 


100 


1,700 



NWREL is satisfied, that all of these progreims, if implemented, 
wculd adhere to the basic tenants of EBCE. How does one account for 
the differences in per pupil costs? What follows is an attempt to 
answer that question. 

On the preceding page there appears a detailed budget for each of the 
five programs (Table 25). Below is an analysis of the variety of 
factors which influence per pupil costs. 

\ 

Since salafries account for a significant portion of program costs 
in each of the five programs, salary allocation seen the .logical 
point of analysis- Table 27 displays the total (professional and 
non-professional) staff salary cost pex student. 

TAhle 27 



TOTAL STAFF SALARY PER STUDENT 



District 


Total 


Number 


Staff 




Staff 


, of 


Salary 




Salary 


Students 


Per Student 


1 


$ 23,400 


30 


$ 780 


2 


$ 40,600 


50 


$ 812 


3 


$ 49,100 


60 


$ 818 


4 


$ 25,500 


25 


$1,020 


5 


$130,900 


100 ' 


$1,309 ' 



There is a very high correlation between staff salaries and per 
student costs. Other cost factors such as facility rental, 
transportation costs, insurance costs and equipment costs have 
varied impact on total student costs. For example, while District 
5 budgeted $90 per student for facility rental, it only budg(;ted 
$10 per student for duplication. While District 4 budgeted nothing 
for facility rental, it budgeted $40 per student for duplication. 
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What have been the effects of the perceived high costs of EB^E ? 

The perceived hiyh costs of EBCE have "-aused potential adopters to 
thoroughly examine the anticipated costs, according to the EBCE 
implementation staff, but have not prevented districts, even those 
m rather severe financial difficulties, from planning to adopt EBCE. 
The fact that one district in the Pacific Northwest operationalized 
an EBCE program based on (CE)2 in FY 75 and that other districts have 
firm plans (see^the above question on proposed budgets) that can fit 
into a school district's budget without undue difficulty seems to 
have reassured most potential adopcors. 

8 . What were the most frequent questions asked about EBCE by various 
groups in districts considering tne adoption of EBCE? 

According to the EBCE implementation staff at NWREL, most adopters* 
questions can be classified into eight areas. These include 
questions dealing with: 

a. Legal problems in setting up EBCE program 

b. Insurance — Workmen's Con^nsation 

c. Costs 

d. Recruitment, selection and training of staff 

e. Recruitment and maintenance of employers 

t 

f . Potential conflict of EBCE with existing programs 

g. Problems of developir^g an alternative program that might serve 
only a segment of th^ student population 

h. Student selection, recruitment and outcomes 

9. In the opinion of the EBCE imp] pmentation staff, where are the EBCE 
resources the strongest in. supporting the adoption process? Where 
are they the weakest ? 

According to two members of the EBCE implementation staff, EBCE 
^ implementation resources are strongest iti the following areas: 

a. Materials — Program Overview, user handbooks, training packets 
and the EBCE slide tape 

b. Technical Assistance — Availability of training and problem 
solving assistance, implementation timelines and budget 
information 

c. Open relationship with the program directors of the new EBCE 
programs. 
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Weaknesses involve a failure ito develop "turn-key" operations for tJae 
EBCE in^iementation process knd include: 

, a. Absence of an implemeni:ation training manual (to be developed 
in the fall of 1975) ' 

b. Weak communication links with State Departments of Education 
{being improved ait^i the initiation of Part D, Vocational 
Education Act activities) . 

1 

10 . What are the types of liiWREL technical assistance requested by adopters 
of . EBCE? 

The following question was presented to aight participants at the end 
of an EBCE inplementation training workshop held in Match:' Respoiises 
are li'^ted below the question. Numbers following the statements- 
refer to the number of respondents giving each statement, if more 
than one. - ^- 

What additional information or technical ^ssidtcJice, if any, 
would you like to receive from NWREL EBCE during the next 
several months? 

— any new ideas and material updates (2) 

— exanples of different projects with names blocked out 

— help with answering specific questions as we develop our 

program and staff are identified (2) 
--help in setting up an evaluation system 
— visual showing all the elements of the (CE)2 program 
— visual showing the "flow" of activities in the Basic Skills 

area. Life Skills area and in the Cartel Development area 
— need latest edition of Employer/Community Resources 

In addition, NWREL EBCE technical assistance has been requested in 
developing student assessment and program evaluation strategies, in 
reviewing district-develdped materials and in clarifying how to use 
materials. 



11 - Are there certain critical events that occur in a district's 

decision-making process regarding adoption of EBCE that need a 
specific period of time to "ferment "? 

Critical events do exist (see implementation timeline, question 3 
above) and adopting districts need time to reflect, consider and 
discuss the adoption before the decision can be made. The 
inplementat ion staff interviewed are reluctant at this .time to 
identify which events specifically need time to "ferment." 
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What methods were used in recruitincj staff i community and Employer 
sites, and students for EBCE? How effective did the local district's 
feel those methods were ? " \ 

Data on recruitment methods are incomplete. Students at the ^rious 
sites were recruited through student assemblies, parejit-student^^ 
meetings, school bulletins, coromuni^ty newspapers and radio \ 
, announcements, and letters to parents. \^ 

In many sites, employers from existing networks (e.g., Work-Study 
Program) were utilized, while in others presentations were made at 
meetings of key groups (e.g., Chcimber of Commerce). 

No data on recruitment of staff are readily available nor have 
systematic data on the effectiveness of various techniques been 
assembled. 

What prox>ortion of students who express an interest in EBCE actually 
complete application procedures? Why do other students decide not 
to join EBCE ? 

Twenty^ight' percent of the 224 students who requested an application 
actually returned the conpleted forms to the {CE)2 staff. One- 
hundred and 'sixty questionnaires were mailed to the homes of those 
Tigard High School students who asked fop an application to (CE)2 ' 
durin5 recruitment but who failed to return it. The questionnaire 
was designed to find out why students did not return their application 
what their future plans included and what further recruitment 
information vas needed. 

Sixty-two questionnaires were returned in the self*addressed stamped 
envelopes yielding a return rate of 39 percent. No followup 
activities were initiated since the school year had already terminated 
A copy of the questionnaire containing the tabulated responses is 
included in Appendix L. 

Thirty-one percent of the respondents did not apply for i^^) 2 k)6cause 
they preferred the type of education given at Tigard High School. 
Other factors and major concerns in the decision not to apply for 
(CE)2 included: 

"I was not really sure what I would be required to do in (CC)2." 
(28 percent) 

4 

"I am concerned that (CE)2 might not properly prepare me for 
college." (25 percent)' 

"I did not want to leave my friends at Tigard High School." * 
(24 percent) 

Parental reactions to student^* interest in (CE)2 were mixed. 
Seventeen percent er^couraged the student to join (Ct) 2 while 13 
percent were opposed to the idea. A larger number, 38 percent, were 
neutral on the subject. 
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When asked about future plans, the largest propor-tion of these 
nonapplicants, 35 percent, said they plan to attend a four-year colleqe-* 
after high school. Thirty-tv^o percent plan to attend a vocational or 
community pollege. As a further indication of the intent to pursue 
formal education, only 10 percent of . these students plan to be 
working full time following graduation. 

Seventy-two percent of the students felt the information presented 
about (CE) 2 was adequate to answer their questions. The most common 
information need cited by the remaining students involved information 
on specifically what the student would b3 required to do at (CE)2. 

J 

When asked if they, would be interested in joining (CE) 2 during their 
' senior year, sophomores were split in their response. Thirteen 
percent responded with a definite "yes" and four percent with a 
definite "no." Seventy-nine percent expressed varying degrees of 
uncertainty. 

14 . What were the reactions of districts t'o the £BCE user, handbooks ? 
Were they read? How were they ug»d? What sections yere found most 
and least useful? What changes have been suggested for improving 
the handbooks ? 

To date, formal feedback on the use of the EBCE user handbooks has 
been received only from four sites using selected EBCE materials.. 
Staff members at these sites recei\ ! prototype * versions of the 
handbooks, but, because they were using only selected EBCE materials, 
did not have the opportunity to assess the usefulness of the total 
handbook system. 

Informal feedback from sites planning to adopt the full EBCE model 
and from the EBCE implementation unit suggest that th^ handbooks 
are viewed as useful and will be utilized. Further data on this 
question will be collected in FY 76. 

15, What role have th_e^ Statewide Education Agencies (SEA) played in the 
j^mp 1 ementati on o f EBCE ? 

N/vFKL began i"S forma' r i^icdtxcn efforts with a sefif^s of information 
sharinq m^etin js through the states in its roqion. Personnel from each 
. of the sea's involved were informed of, and participated in, these 
sessions which were held in May of 1974. Shortly after these- initial 
sessions, an NWREL/EBCE advisory group composed of representatives of 
the state boards of education of Alaska, Jdaho, Montana, Oregon ajid 
/\ Washington was formed. An initial meeting of this body was held in 

Tigard on September 20, 1974. This group ad^?ised NWREL staff on 
criteria for selection of the final sites for field model replication 
and field testing EBCE prototype materials and participated in applyinq 
the friteria to select NWRElL's pilot site?. This group continued to 
function in an advisory capacity to NWREL 's implementation efforts. 
One ^EA (Alaska) has funded bot^h tlie basic costs of the initial pilot 
site in that state and the travel and per diem costs of NWREL 
technical assistance. 



With the initiation of Part D activities in July 1975, the role of 
sea's in the implemei^tation process will expand greatly. LEA awareness 
of EBCE will be expanded through the SEA and the SEA will play a 
coordinating role in the implementation process. A more detailed study 
of the SEA roles should be conducted during the corning year. 

Have LEAs raised questions about the differences in the four EBCE 
programs opeirated by the laboratories? If yes, what differences ? 

Prior to the dissemination effort)5 undertaken through Part D, which 
emphasize the differiehces between the four versions and encourage 
adoptors to make a choice, local districts, while aware of the 
existence of four versions, did not inquire further into differences. 
Further research on Part D act^v^^es could provide data on what 
differences local districts see iir^xjrtant . 

Have there be^n any requests upon the (CE):> demonstration site that 
have been unable to be filled this year? Have there been requests 
to visit additional EBCE sites? * 

According to the coordinator of the implementation unit, most requests 
to visit the {CE)2 derooiistration site in FY 75 were filled. A few 
requests were not made with enough lead time to coordinate a visit 
with the (CE)2 operations staff. A very limited number of potential 
adoptors requested visits to oth?r EBCE sites and were directed to 
Project TOTAL in Hillsboro'. 

The demands for a* demonstration site are not very consistent. Some 
potential adoptors are not interested in a "walkthrough" even when 
it is encouraged, while others insist on seeing "real staff and 
students." It is anticipated that in FY 76 (CE)2 will play a 
somewhat limited demonstration role in making potential adoptors aware 
•of EBCE, but will be an integral part of the inqplementation training. 

What influence has EBCE had on other types of career/ vocational 
education programs in the local school districts ? 

i 

Conversations with the instructor in the Diversified Occupation class 
of the Cooperative Wprk Experience (CWE) Program at Tigard High 
School and an inspection of enrollment trends in the Co'op program 
indicate that EBCE may have had an adyerse effect on enrollment in 
the Diversified Occupations class which gives students an opportunity 
to explore various careers. Enrollment in other Coop classes that 
emphasize job skill training in a specific career area (e.g., office 
work, medical technology, etc.) have remained the same or increased 
since the inception of EBCE. These limited data may indicate that 
students at Tigard view EBCE as a viable alternative for career 
awareness and exploration bat see other career education programs 
as more appropriate for in depth job training in a specific career 
area. The potential influence that (CE)2 enrollment may have had 
on the Diversified Occupations cluster of CWE appears lower, 
however, since the CWE progrcim normally enrolls only seniors. 
During student case study interviews this yea^ the four (CE)2 
seniors interviewed indicated that they had nevsr cor\sidered the 
possibility of joining CWE ^t the time they decided to join {C£)2- 



The proqram director of Pro3ect TOTAL reports that their EBCE 
program has had no impadt on enrollment in other career/vocational . 
education programs in the Hiilsboro district but that student 
screening and selection procedures may prevent such impact. 

Programs both in^Tigard and Hiilsboro have reported EBCE impact on 
the way they present educational' services to students. In Tigard 
the EBCE Learning Site Analysis Form and the Competencies were 
adapted as integral parts of an Alternative Futures Program at the 
high school. The (CE)2 counseling concept has also been adapted by 
the staff at a Tigard J.unior High School and the Cooperative Work ' 
Experience Program has adopted employer seminars based on those 
\developed by (CE)2. In Hiilsboro; the employer net,work and procedures 
^r ' student use of community sites are being adaptea for use by 
e^^sting work experience programs • 

WhatVppear to be the most critical factors in determining whether 
a disl^ict will adopt EBCE? " * 

Listed bGsl6w (not necessarily in order of importance) are the critical 
factors a^x seen by the EBCE implementation staff: 

a. The avaxlc±>ility of money is of course a factor The emphasis 
♦ is not on^ a large amount of money, but on wheth&r the money is 

available \(i , can be used) for EBCE. • 

b. A commitment con the part^/of tl>e admxnistra*-ion and staff *to 
provide alternatives to students, and especially a commitment 
to the EBCE concept . 

c. A willingness to let nonprofessional community members educate 
and certify learning* 

d. A strong "and determined leader who is committed to the EBCE 
concept and who takes responsibility for making others aware of 
it. „ ' 

e. Enough lead time to inform the variety of audiences about EBCE 
an'd to clarify their role in it** This "systems" approach is 
very much a part of EBCE. • ^ 

If i:he implementation unit had the op portunity to redo this past 
year's implementation activities, what wou^ld~be done differently? 

Both members of the implementation unit interviewed expressed 
satisfaction with the conduct of events over the past year. The one 
area that both mentioned as an area that needed improvement was 
contact With state departments of education. More work with state 
departme;nts would have facilitated the handling of credentialing 
q'jostions and other issues that aVise (e.g., Workmens Condensation) 
and would have started building the needed "turnkey" function. 
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CHAPTER V. SUMMARY ^ AND DISCUSSIONr OF FINDINGS 



Introduction > 

Tnis chapter of' the evaluation report contains a summary and discussion 
of the major evaluation findings for the 1974-75 school year, first 
regarding the iCE) 2 project and second regarding EBCE implementation 
activijties. 

The (CE)2 summary contains ^(a) the results derived from a comparison of 
(CE)2 experimental students with control group students, (b)* results 
pertaining po all (CE) 2 students, (c)' findings from the seven student 
case studies, and (d) program evaluation findings. Information 'o have 
been provided by Educational Testing Service (ETS) , the external 
evaluator, was not received in time to be included in this report. A 
separate ETS report scheduled for December 1975 will probably contain: 
.^n anthropological study of {CE) 2* results of their survey of employers, 
parents and formef {CE) 2 students-; and an analysis of an indepth interview 
with a random sample of 20 {CE) 2 experimental students and the control 
group students. A separately bound volume, of appendices provides more 
detailed data in support of data presented in this report. 

Summary, {CE) 2 Evaluation Findings 

Comparison of {CE) 2 Experimental and Control Group Students . In order to 
assess with validity the effects of (CE)2^n participating students a 
true experimental design was used as part of the total evaluation (p- 9).* 
From the total list of sophomores and juniors at Tigard High School 
applying for (CE)2 in the spring of 1974, 31 students were selected 
randomly as (CE) 2 experimental students for 1974-75 with the remainder 
designc»ted as control group students who would remain at Tigard Hiqh 
School and not participate in (CE)2. Of the 31 (CE)2 experimental 
students who were pretested only one dropped out of the program during 
the school year. During this sapae period, 13 of the 25 control group 
students 'who we're pretested left or 'dropped out of Tigard High School. 
This differential attrition may be explained by the ETS. findings based 
upon interviews witrh those dropouts, due after this report. 

Students in the experimental and in the contrJ? group were tested using 
a number of evaluation instruments at the beginning and end of the school 
year (p. 17). These instruments covered the areas of Basic Skills, Life 
Skills and Career Development — the threa focal, areas of the (CE) 2 
curriculum. . It was hypothesized that the (CE)2 experimental students 
would do as well as the controT group students in terms of gains in Basic 
Skills, while exceeding the control group in Life Skilly and Career 
Development skills* On the Comprehensive Te'st of Basic Skills there were 
no statistically significant differences between the (CE)2 expetimfental 
group and the high school control group in reading, arithmetic, or 
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Throughout this summary chapter cross referneces to other sections of 
this report are provided where the reader may obtairl more detailed 
information. 
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study skills.* - ' ' - 

. » ■* , 

Questionnaires administered to both experimental and control group ' , 
st^ents at the beqinning and end of the school year included items tQ ' 
assess stud&nt readirig habits.* Marginally sicfnificant differences*^ were 
found favorVng the experimental group over the centrol group in increased 
reading during the year. These differences were due mai,nly to increases 
in the amount of reading of pamphlets and newspapers (p. 55) . M 

Because the Life Skills curriculum component of (CE)2 does not have a 
direct parallel iji the regular high school pragrcim, o^lly inditect measures 
of these skills were assessed on a comparatfve basis. Two attitudinal 
instruments* the Psychosocial Maturity Scale (PSM) and the, semantic 
differential were used to compare the experimental and control groups in 
the Life Skirl I3 area of Personal-Social Development (p. 47) . The PSM was 
used to assess growth, in the goal-i^elated behaviors of self-reliance , work , 
identity, conmunicatiori, role , tolerance, trust , openness to change and 
social commitmertt, while the semantic differential was used as a measure 
bf growth in attitudes toward the concepts of "one," "learning," "work" and^ 
"community resources." No significant differences were found between the' 
two groups on any of these scales except the work scale of the PSM where 
the control group demonstrated significantly higher growth than the 
experimental group. On both of these instruments thi (CE)2 experimental 
group showed a decrease over theiyear on the work scale. Built into the 
PSM instrument is an internal, validity scale which n^asures the 
respondents* willingness to be fremk in their self-reports. Judging by 
this scale, the (CE)2 experimental students became significantly more 
honest in their responses at, posttest time than, at pretest time. Based 
on these findings the evaluators' insights gained from intensive student 
case studies this year, and a discission with the author of the PSM, it" 
is likely that the (CE)2 tadents' decrease in scores on the work scales 
of these two instrument^ is an indication that the (CE)2 experiences at 
jo^ sites have helped students become less idealistic in their concept 
of wor^w and more critical in their self-assessment of their own personal 
work habits. The decrease in the work scores may also indicate that 
students are being influenced in their work values at employer sites 
in ways that some educators would view^ as less positive. For example, 
at the beginning of the school year only 8 percent of the (tE)2 
experimental group agreed with the statement that "It i more important 
for a job to pay well than for it to be interesting" while at the end 
of the year '23 pefcent of the (CE)2 experimental group agreed with that 
statement, ^ 



Due to considerable attrition in the control group, those control 
students who dropped out of. school had higher pretest scores on 
arithmetic applications than the control students who remained in 
school, making the final control group somewhat lower than the 
experimental group on- arithmetic applications at present time. In 
order to statistically adjust for initial pretest differences between 
the experimental and control group a multivariate analysis of 
covariance computer program was used. Here and in other analyses ih 
' this report, a p level of .05 was us^d to identify significant 
differences. A marginally si^gnificant difference is defined iii the 
report as .05<p<.10. ^ J 
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Tho S elf Directed .S earch (SDS) was administered to the experimental and 
control group on a' pre- arj-d posttest basis to learn what changes might , 
result from an expax>i4nental program such as (CE)2 (p- 51), No 
significant difjfer^nces were found between the two groups iji the 
^consistency of their career choices with 'Holland'" s model* nor^in their 
ability to discriminate between various career interests that they liked ^ ^ 
or disliked. Some (CE)2 students became more consistent in their career 
choices while others became less con%istent. THip seems to reflect .the 
variety of experiences open to students in this program. ,Some tend .to 
♦explore a wide variety of careers while others prefer to gain indepth 
experiences in one or t/o career areas. ,^ 

The extent to which students could matgh their career preferenceis with 
their personal interests and ability was measured by comparing th^ 
congruepcy between students* projected careers as stated on the, E^nd 
Year Questionnaire and their three digit SDS codeg, basod upon Holland's- 
model and the Occupations Fin der developed by him (p. 52) . Nc? 
significant differences were lound betwe^ th^ experimental and control 
groups in ability to match careers with personal interests/^ In each 
group, 80 percent or more of the studtents .demionst rated this congruerce' 
for both their first and secomd cateer choices^ ^ ' . 

Students in the experimental ai i control groups were alsor compared on their 
knowledge of information related to the world of Work. The stedent End of 
Year Questionnaire contairred items developed by D. J. PredigfeY of the 
American College Testing Program. Responses for these* items wereVrep'^rted- , 
for a national sample of 9,107 ^lev^th grade students.** The difference in 
performance between the experimental and control groups of students was 
statistically signifjicant in favor of* the (CE) 2 st^ude^its.' In comparison 
witri the national sample of eleventh gradors, (CE)2 stu^ents> scox^ed the. same 
higher than the national sample on eight out of nine items (p. --'5^), ' 

Also on the student End of Year Qtiestionnatre , the experimental and 
contjiroi group students ^ere askod, to list^their top two career choices. 
No Significant differences were found in the level of career choices 
bet\j;eerv .the two groups or in the amount of education they, planned to 
pursue after high school. Significantly nwre ^f the (CE)^ students, 
reported having observed or worked in the ^careers of their choice than - 
did corttrol group students (p. 54). * ' , 



Significantly more experimental students than coatrol students felt they 
would be able to complete ^the necessary steps for entering a career of 

* For an excellent description of this model and the research 

supporting it, .the reader is referred to John L. Holland, Making 
Vocational Choices; A Theory of Careers ; EnglewooA Cliffs,. New 
Jersey: Prentice-Hall, Inc. , 1973. 

**. Prediger, D. J., Roth, J. D., and Noeth, R. V. ; ^N ationwide S utvey of 
Student Career Development: Summary of Results ; (ACT Research Report 
No. 61); Iowa City, Iowa: The American College Testing Program, 1973. 
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.thoir cKoict^. No significant differences were observed between - 1 
experimental and control groups in the sources of information used! to 
olimmatG potential careers nor were there differences in the propbrtions 
of students able to list 'jobs that they had ruled out as career choices 
during the year (p. 55) . i 

Since one of the Hypothesized effects of community based experimental 
learning is the increased use of public resources and part icipationV" 
communiCy activities, the evaluators asked students on the End of Year ' 
Questionnaire to indica the number of times they used various community 
respurces. Experimental • >nts reported s.\gnif ic^tly more use of 
public resources, especially public libraries and greater attendance at 
public meetings, than did the control group (p. 55). 

Both (CP) 2 and control group students were asked, on the student End of 
Year Questionnaire, to rate how well they felt their educational program 
this year helped them attain 21 educational goals. These goals were 
based on (C£) 2 . program objectives and_covered the areas of, Basic Skills 
Life Skills and x:areer Development. The experimental group gave (CE)^ ' 
sia-ificantiy higher ratings in 14 of the 21 goals. For the remaining, 7 
goals, all differences were nonsignificant and except for one, were in 
favor of (CE)2. In ratiny tr^e perceived overall effectiveness of their 
education the-(CE)2 students again gave significantly higher ratings 
(p. 55). 

Non comparatlve (CE) ^ student Outcomes . Information in the previous 
section discussed the comparative outcomes of 30 (CE) 2 experimental 
group students and }2 control group students at Tigard High School. 
Additional data were collected and analyzed for all students 
participating in (CE)^. This total group of 52 (CE)2 students pre- and 
posttest includes 10 students who were in (CE) 2 as juniors in 1973-74 
and returned to complete their senior year in (CE) 2 during 1974-75. 
Eic»ht other (CE)2 returning seniors left the program during the school 
year. Also included in the total (CE)2 group are students who were 
pX3selected and cpjaranteed admission into (CE) 2 (p. 9). 

During the 1972-73 school y^tar no statistically significant changes weie 
exhibited on the Com^r ehensiye Test of Basic Skills by the initial 25 
students participating in (CE)2. During 1973-74, students made 
statistically significant gains in all areas of the CTBS except 
, language mechanics. This year, (CE)2 students showed a significant gain 
•in reading comprehension, arithmetic concepts and arithmetic application, 
'but not in study skills (p. 20). 

The gai made on the CTBS this. year iid r.ot differ significantly between 
the 12 preselected s idents, the 10 returning seniors and the 30 
experimental group students despite the fact that the preselected students 
began the .ye^ with higher CTBS scores than the other two groups (p. 47). 




Results of the semantic differential instrument for all (CE)2 students as 
a group inr»^cated a significant increase on the seven conceits, 
especially the conceptfe of "me," "community resources," "adults/' 
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"iearninq," and "schocl," and a significant decrease on the concept of 
••work." During the prior year, (CE)2 students' rating of the concept 
."work" also decreased somewhat between the middle and end of the s'-hool 
year- This decrease in ratings on the concept of "work" has already been 
discussed in the prior section. The concept of "school" was generally 
inLerpreted by new (CE)2 students to mean the regular high school program 
at pretest tim^ anil the (CE) 2 program specifically by posttest time. 
During the 1973-74 school year, (CE)2 students demonstraced a significant 
increase on their ratings of the concepts "me" and "school" thus 
supporting a tendency observed in the previous year for (CE)2 students 
to feel more positive toward themselves and toward their educational 
experiences after being in (CE)2 for a year or more (p. 50). 

The (CE)2 students as a whole showed significant growth on the PSM scales 
measuring trust and openness to change, a significant decline on the 
social desirability scale and a marginal decline on the tolerance scale. 
The decline on the social desirability scale suggests a willingness to 
be more frank with their answers at posttest time than at pretest time 
(p. 48). Three basic attitudes characterize "enlightened" (credible) 
trust: General belief in the acceptability of reliance or dependency 
on others, rejection of simplistic views of the "goodness" or "badness" 
of human nature, and recognition . of individual and situational factors 
ithat limit trustworthiness. (Example: "If people are picked in a fair 
way to be on a trial jury, they are sure to reach a fair decision")* 
The change variable includes general openness to socio-political change 
and recognition of the costs of both the status quo and change. (Example: 
"If everyone is to be really equal, some people will have fever advantages 
than they have now.") Tolerance involves the person's willingness to 
interact with individuals and groujj^s who differ from the norm and an 
ability to be sensitive to their rights. It also involves an awareness 
of the costs and benefits of tolerance. (Example: "If I had a choice, 
I would prefer a blood transfusion from a person of the same skin color 
as mine . " ) \ 

\ 

The case studies conducted this year suggest that the increase in trust 
and openness to change were probably influenced by the supportive 
atmosphere of the iCE) 2 staff observed at the learning center and by tho 
interactive experiences that (CE)2 students encounter with a diversity 
of employers and community adjlts. Thfe evax'iators have no suggested 
explanation for tho marginal decline irt \the tolerance scale. P 
comparison of the three (CE)2 subgroups^, |on the total PSM revealed no 
significant trends in growth among the three groups (p. 49)- Scores for 
this year'^ (C :)2 students on eight of tihe nine PSM scales were higher 
at pretest time this year than they wer^\ t'the posttest for FY 74. This 
factor is likely to have tempered the am6unt of upward growth registered 
by (CE)2 students this year in comparison^ with the more dramatic growth 
registered by the (CE)2 students the prior year (p. 48). 



Greenberger, et al; The Measur emen t and ^^-y'^^cture ^f Psychosor la I 

Maturity ; The Johns Hopkins Universit;y, Center for SocTaT ~ 
Organization of Schools; Report No. 17p; March 6, 1974; p. 33. 
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In terms of student evaluation of (CE)2# a] 1 but one of the (CE) 2 
students indicated on the student End of Year Questionnaire that 
they did not regret tneir decision to entc^r the program. Comi>arinq (CK)\> 
to t^ regular hiqh school program, 96 percent of the students reported 
that iCE)2 provided more opportuiiity to learn about occupations and 70 
percent reported thit it provide/d more opportunity for general learning. 
Ninety percent of the (CE)2 students reported that they were more 
motivlated to learn m {CE)2 than in the regular high school (p. 56). 

When asked what they perceived to be the greatest strengths of the (CE)2 
program, 33 percent of (CE) 2 students identified the opportunities for 
'*hands en" learning, 33 percent identified the empathetic and helpful 
staff, and the rest mentioned a variety of things including the opportunity 
to learn about careers and the freedom and responsibility given students 
(p. 50) . 

The most commonly mentioned weakness of the program (mentioned by 15 
/percent the students) involved difficulty or inconvenience m securinq 
a desired employer .mte. Other problems mentioned included tran? ortation 
problems (6 percent) and too much work (6 percent) (p. 55). 

(CE)2 students were rated by staff members in November an*^ again in May 
on seven areas of s;{.udent behavior. The (CE)2 students showed a 
significant growth in all areas except "Condurts conversation with an 
adult that reveals his/her self-confidence," However, when conditioned 
for the first five scales, this scale does become significant. A 
multivariate analysis of variance indicated a high correlation among 
•these seven areas suggesting that they could be reduced to three scales- 
"Capability to apply learned behaviors and to assume responsibility," 
"ynderstands another person's messages and feelings," and "Conducts 
conversation with an adult that reveals self-confidence" (p. 53). 

Documentation of weekly discussions by the (CE)2 staff regarding 
observable behaviors in each student have revealed that many students 
have qrown substantially in assuming responsibility for their actioKs .and 
in cooperating witii program staff and employer instructors. Growth U^s 
been noted also by the staff in students* ability to communicate- 
effectively with -adults and with fellow students. These areas of growth, 
were also reported by the staff on a May questionnaire (p. 57). 

In the area of career development, approximately 250 occupational skills 
were recorded by employers as having been acquired or practiced by (CD 2 
students while at employer sites this year.* Skills in all occupational 
areas of the Occupa tional Ou tlo ok Handbook , except the transportation 
industry and social sciences, are represented. Those areas with the 
highest number of skills learned are office occupations; service 
occupations; mechanics and repairmen; health occupations; and art, 
design, and communications. These occupations reflect the significant 
gain in rating the realistic scale of the Self Directed Search from 
pretest to posttest (p. 52). , " 



* The reader may wish to examine Appendix I of the evaluation report to 
.observe the types of jobs explored by (CE)2 Students. 
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student Case Studies . Intensive case studies* of seven (CE) 2 students wore 
prepared as a major part of the total evaluation this year. The primary 
purix^so of the case studies was to give the reader 'insights into a 
.student's activities in the (CE) 2 program that could not be gleaned from 
quantitative group data. 

A draft copy of each student's case study was given to him or her in July. 
Students were asked to read them and verify their accuracy. A final 
interview with the students was then conducted to fill in any possible 
gai^s in information and to obtain their reactions to the report. Each 
case study included a description of the background of the student, why 
he or she entered the (CE)2 program, activities and progress while in the 
program during both semesters this year, student reactions to (CE)2f and 
parental reactions to the program and to the progress of their son or 
daughter. 

Multiple data collection strategies were used in this study to allow 
the evaluators to obtain a cross validation of information about each of 
the students. These methods included (a) observations of case study 
stjmdents at employer sites three times during the year, (b) interviews 
three times a year with the student's employer instructor at the time of 
observation, (c) parent interviews in March, (d) mdepth student 
interviews four times a year, (e) informal discussions with program staff 
and (f) a review of student projects and' otho^ documents. A total of 23 
records were also identified as secondary sources of data for each student 
and a set of guide questions was prepared for analyzing or reviewing each 
source. These records included employer evaluations of students, student 
products, test scores and staff evaluations. 

The case studies show the an^cieties, struggles, frUotrations and personal 
growth of these seven young people as they progressed through (CE)2- The 
case studies have also provided direct evidence leading the evaluators to 
conclude that: 

• (CE)2 appeals to a wide range of students 

• Parents support the (CE)2 program 

• Work values are being realized, developed and chanqpd as a 
result of (CE) 2 

• Employer instructors participate in EBCE at different levels 
of involvement 

• Students utilize community sites at different levels of 
involvement 



* For the complete case study write-up, see Chapter III, Section E and 
Appendix G. 
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• F'ew hiqh school students have made a single lifetime career 
choice 

• Students learn from direct experience 

^\ 

Parents of the case study students were interviewed this year regarding 
their views of (CE)2 and of their son's or daughter's progress in the ^ 
program. The. greatest gains thes:'=' parents observed were growth in 
interpersonal relations skills, knowledge about different vocations, ,and 
interest in euucation, 

Program Evaluation Findings , While the previous findings in this summary 
chapter have dealt with student outcomes, this section contains evaluation 
findings regarding the (CE)2 program operation, the student goals and 
learhing strategies. 

At the end of the school year, ICE) 2 experimental students and control 
students from the high school were asked to complete a questionnaire 
containting items related to their feelings about their year's 
educational experience. Students were asked to rate, on a scale ranging 
from 1 (of little or no help) to 5 (very helpful) how they felt (CE) 2 or 
school (cfepending upon which program the student was in) experiences had 
been to them this year in attaining education goals. The 4CE) 2 students 
rated 20 of these 21 goals higher than did the control group. On the 
remaining items, there were no significant differences between the two 
groups. The (CE)2 experimental group rated their educational experiences 
as significantly more helpful to them than did the control group students 
in the following 14 goals: 

1. Solving problems logically, 

2. Understanding the role of science in our society. 

3. Understanding more about self. 

4. Developing creativity. 

5. Learnii-g how interests and abilities fit into potential careers. 

6. Learning , what to took at in considering a job, 

7. Learning the Basic Skills necessary for careers of interest. 

8. Improving math skills. 

9. Helping know what levf^l of Basic Skills proficiency is 
required in jobs of interest. 

10, Becoming acquainted with a broad range of resources to use in 
gathering information for work and decision making. 

11. Communicating comfortably with adults. 
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12. Taking responsibility for own actions. 



13. Using information obtained through direct experiences in making 
decisions. 



14, 



Holping to feel prepared to accept adult responsibilities. 



On two separate questionnaire items measuring the overall quality of the 
program and the opportunity to progress at one's own rate, the iCE) 2 
experimental students rated their program significantly higher than did 
the control group (p. 55) . ' 

In the Life Skills area students completed most of their learning throuqh 
work on individual projects. Eighty-five projects were completed in 
critical thinking, 115 in science, 81 in creative development. Students 
this year completed an average of 7.3 projects as compared with an average 
of 5.5 projects completed by last year's students. Each of these projects 
had indi^vidual objectives and criteria that were applied by the learning 
managers'" in evlauating the project. All students in (CEjj are expected 
to engage in activities to improve themselves in critical thinking, science, 
creative development, functional citizenship and personal-social development. 
While an opportunity to do this may be available in a regular high school, 
not all students there are expected to interact with each of these Life 
Skills areas (p. 23ff). 

Students enrolled in iCE) 2 for two years are also required to complete 
13 competencies (such as maintaining a checking account in good order) 
to graduate from the program. The percentage of all (CE)2 students who 
wej-e certified on competencies ranged from 43 percent. of the -students 
completing a competency requiring them to maintain the best physical 
health and make appropriate use of leisure time^ to 98 percent of the 
students completing the competency on transacting business on a credit 
basis. Many more competencies were completed by students this year (488) 
than last year(289) . Students completed an average of 9.4 competencies 
this year while they completed only an average of 5.6 competencies last 
year and an average of 3.0 competencies two years ago. This increase 
over the three-year period reflects a clarification of work required to 
complete each competency as well as an improved student accountability 
system that helped students realize what work was expected of them and 
encouraged them to complete those tasks before graduation (p. 31). 

(CE)2 staff members were asked to rate the importance and, separately, 
the effectiveness of the program in utilizing 15 student learning 
strategies.* The average rating by the staff on importance of each of 
these learning strategies was four or higher (on a five-point scale) , 
except for employer seminars and student group actitivites. The learning 
strategies considered .most important were: the student accountability 
system, student negotiation, individual projects, the learning level 
process and the competencies. Each of these learning strategies was also 



For a description of the various learning strategies the reader may wish 
to refer to pages 203 to 336 of the EBCE Curriculum and Instruction 
handbook developed by NWREL. ' ' ""^ ~~ ' 
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given an average rating of 3.5 or higher on ef fectiveness ^ except for 
student orientation, employer ^seminars and group activities. The lear.iinq 
strategies judged most effec\:ive by the staff were: the student 
accountability system, stud-^nt negotiation, individual projects, journals, 
competencies. Exploration Packages and the ILA Basic Skills materials* (p. 56) 

Two, factors mentioned most often on an open-ended question by staff members 
as contributing in a major way to the success of the (CE)2 program this 
pa?t year were (g) intra-staff and^ staff-student cooperation add rapport 
ano (b) the wide range or mix of student abilities. There was no 
consensus on what factors limited the success of the program, although 
uncertainty about the future direction of the funding agency (NIE) was 
mentioned by two staff members as a constraint (p. 57). This year's (CE)2 
students saw program strength primarily i > its provision of many 
opportunities to explore /arious careers, to learn some meaningful skills 
and to be in an' environment that is friendly and^ supportive . They 
indicated no problem in locating and obtaining necessary resource materials. 
Parents, employers, students and visitors all remarked that the iCE) 2 
staff's competence, enthusiasm and concern have been major factors 
c6ntributing to the program's success (p» ). 

S*-udent recruitnen, procedures in April and May for the 1975-76 <=chool 
year were highly successful in terms of recruitment objectives. An 
attempt was made to recruit a large number of students with a wide range 
of abilities and aspirations to accurately represent a cross'-section of 
students from Ti'gard High School. The large number of applicants for 
(CE) 2 required random san^llng of participant and alternate students for 
next year. The baseline data collected. on the newly admitted (CE)2 
students for 1975-76 indicate that they are a representative cross- 
section of students with a wide range of abilities. 

Of the seniors in (CE) 2 in May 1975, 21 graduated, 3 dropped out of the 
program aid 2 plan to return next year to complete program requirements. 
Three of the 21 graduating seniors completed program requrrement early 
and three graduated before the normal Tigard High School graduation time. 
The fact that not all students enrolled in (CE)2 automatically graduate 
but instead are held accountable for successfully completing the 
program's learning requirements is perhaps the greatest proof of the 
competency-based nature of the program. 

Evaluation of EBCE Implementation Activities 

Various EBCE implementation activities for the year were evaluated 
including the planning phase at four total model replication sites and 
the operations phase at a site in Hillsboro, Oregon called Total 
Opportunities Through Action Learning (TOTAL) . Questionnaires were sent 
to five school districts in the Pacific Northwest who utilized one or 
more of the following NWREL EBCiZ materials in FY 75: user handbooks; 



ILA is thi^ Individualized Learning for Adults program available from 
Research lor Better Schools, Philadelphia. 
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Exploration Packaqe, Student Journal and Leamir^q Site Analysis Form. 
A replication training workshop was also evaluated, as were selected 
implementation strategies.* ' 

Planning at Full Model Replication Sites . Orientation, training and 
technical assistance were provided to districts in the Northwest intcfrested 
in implementing EBCE. The TOTAL program in Hillsboro, Oregon elected to 
begin operation during the 1974-75 school year. Four other districts-- 
Billings, Montana; Colville, Washington, Kenriewick, Washington; and 
Kodiak, Alaska— chose to use 19 74-75 as a planning year and to begin 
operation of EBCE during the 1975-76 school year. Several other 
districts participated in EBCE planning during 1974-75 but were unable 
to begin operations during the 1975-76 year because of budgetary 
constraints. 

Information on each of the four pilut sites that will begin EBCE 
operations in 1975 was collected and organized into the following * 
categories: advisory board, school staff, number and characteristics 
of students, employer recruitment, physical facilities, funding, parent 
involvement, school board action, and EBCE materials received and used 
(Appendix M) . 

Project TOTAL . The NWREL EBCE evaluators were requested by the director 
of Project TOTAL to provide an indepeendertt assessment of that project. ^ 
TOTAL is a pilot alternative education program, using the (CE)2 version 
of EBCE to help students v^o have not progressed satisfactorily in the 
regular school program. Project TOTAL operated in the Hillsboro Union 
High School District during 1974-75 with a maximum of 30 students from 
grades 9 to 12. Small groups of students were added to the' project at 
various times throughout the year to work with a staff of three full-time 
members and a part-time director. 

The evaluation of TOTAL by the NWREL evaluators consisted primarily of 
an analysis and independent interpretation of their data, supplemented 
by an interview with each of their staff members and with a random sample 
of six students. Change data from student test scores are not contained 
in this report since various students began the program at six time 
periods throughout the year; some students failed to complete the 
posttests accurately and others failed to take the posttestc at all, 

A comparison of baseline data between students in TOTAL and those in 
(CE)2 indicated that the TOTAL students were at the eighth gra'de level 
in reading and study skills on the CTBS and substantially lower than 
that in arithmetic. However, on the semantic differential scores and 

Psychosocial Maturity Scale scores, the TOTAL students had 
^proximately the same scores as those in (CE)2 (p. 111). 

Perhaps the most significant data regarding TOTAL students were fqund m 
their attendance records. During the year prior to entering TCTa£ these 
students had an average school attendance of 36 percent. During the first 
and second semesters in Project TOTAL, however, these same students 
averaged an 86 percent attendance rate (p. 111). 
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1 . ' Program Strongths • j . 

The staff of the TOTAL program appear to be interested m the 
students and to enjoy their work. The students of TOTAL share this 
perception and report that the freedom to learn what they are 
interested in without the pressures associated wit?i the regular high 
shcool program are additional 'strengths. Good community and school 
support were also reported by the program staff. . 

2. Program Weal^nesses 

Tyb of six students interviewed and one staff member reported that 
inadequate bus transportation was an obstacle which limited th^ 
success of the TOTAL program. Other weaiknesses cited by a staff 
member and confirmed by at least one student involved the lack of 
staff time die to the extra attention demanded by this particular 
student group and the need for clerical help. More staff time is alsg 
necessary to adequately monitor employer sites. 

Evaluation of EBCE Materials . Questionnaire results were obtained from 
four of five school^- districts in the Pacific Northwest where selected EBCE 
materials had been used. Separate questionnaires were used to ob'tain 
reactions to the EBCE user handbooks. Exploration Package, Student Journal 
and the Learning Site Analysis Form. Staff members whb had used each of * 
these materials provided feedback. In addition, separate questionnaires 
were used with students to obtain their reactions to the Exploration " 
Package and to the Student Journal, Employers involved with the Learning 
Site Analysis Form were surveyed. The general reaction to all of these 
materials was favorable (p. 124). 

Staff members at the four sites providing feedback on the EBCE user 
handbooks reported the handbooks were complete and easy to use. One 
respondent commented that in some areas the language bprdered on jargon 
while another respondent expressed the need for a short concise review. 
Because of their length and detail, the EBCE user handbooks were seldom 
read in total but were generally skimmed and consulted as problems arose. 
Three of the four sites used the Exploration Package as it was developed 
at (CE)2. The fourth district is in the process of revising it to 
accommodate poor readers. Staff members liked the Exploration Package as 
a way to help students pinpoint their interests and think about their 
values. Students liked the package as a guide for exploring different 
aspects of careers and as a record of their experiences. Some disliked 
the amount of time and writing activity demanded by the process* 

The Student Journal was used by two sites. Staff from one site regarded 
the Journal as an effective tool to establish trust and caring between 
staff and students. Staff members from the other site were more reserved 
in their praise, indicating only that the Journal had a positive effect 
on those stucj^ts who used it as a communication device. Both sites 
plan to use tffe Journal again next year. Students liked the opportunity 
to express themselves to -the. staff , but as with the Exploration Package, 
reported that it required too much time and writing. 
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The 'Learning Site Analysis Form was utilized 'by three school districts 
to analyze approximately 50 community si±es for their learning potential. 
One site revised the LSAF to make it mare understandable by employers: 
All employees surveyed felt they understood the purpose of the LSAF and 
that the information collected by it coincided with the ir^ perceptions of 
the learning potential of their site. Th^^ report that the LSAF has both 
changed the way they deal with students an^' has changed their employee 
training?^education efforts (p. 124) . 

Workshop Evaluation . A self-rating questionnaire was employed in assessing 
a one-Veek^BCE training workshop held in Tigard in March 1975. Eight 
participants, representing four districts planning for the implementation 
of EBCE in th^ fall of 1975, attended the workshop. Topics discussed at 
the workshop included: the philosophy of EBCE, implementation issues 
cind the use of various EBCE assessment and learning strategies. 

The workshop participants contributed rrany worthwhile suggestions which 
could be used to modify future workshops. Even witn their diverse 
backgrounds and previous understanding of (CE)2f they rated t ha workshop 
high* These participants felt they were we^ll prepared to represent the 
{CE)2 program to students, parents and employers and were able to complete 
prc^gram start-up planning strategies. These participants also gave high 
ratings to their understanding of (CE)2 concepts (p. 125). 

Evaluation of Replication Activities . In order to -synthesize the 
insights and knowledge gained from the EBCE replication experiences this 
year, a set of 18 questions was developed by the evaluation unit in June 
to focus the findings. Questions used incluued: 

— "What are the important steps and sequences needed in introducing 
and implementing EBCE in a school district?" 

— "What are the anticipated costs of operating EBCE in full--modpl 
sites?" 

— What were the most frequent questions asked cibout EBCE by various 
groups in districts considering the adoption oT EBCE?" 

— "What appear to be the most critical factors in determing whether 
a district will adopt EBCE?" 

Answers were provided in this report to such questions and, although not 
given in final and unequivocal terms, should prove useful* to persons 
considering the adoption of EBCE in their districts (p. 126). More conclusive 
answers to these implementation questions will appear in the coming year 
as more districts gain experience with EBCE . 

The clearest criterion in evaluating the effects of the NWREL EBCE 
implementation unit this pa^ year is the willingness and ability of 
school districts to implement EBCE in their schools during 1975*76 using 
local funds. Five school districts in the Northwest will be 
doing that in September after receiving planning help, support and staff 
tif'a^ning from NWREL. A more detailed evaluation of EBCE inplementat ion 
activities will occur in 1975-76. 
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CHAPTEF VI. EVALUATORS' CO^^CLUSIONS AND RECOMMENDATIONS 



This final chapter of the evaluation report presents conclusions and 

recommendations regarding: (a) a synthesis of (CE)2 evaluation findings, 

(b) evaluation issues, and (c) future research needs. 

♦ 

{CE)y Student Findings 

V 

This evaluation report has examined a number of complex and interrelated 
oitcomes of student p^rt.^ cipation in EBCE that cover Basic Skills, Life 
SJ<ills and Career Developnent. The need to synthesize the vast quantity 
of data has presented the evaluatcrs with a difficult challenge;. Findings 
regarding 21 (CE)2 student goals have been described in Chapter III and 
summarized in Chapter V. An important question i'^s whether there is a 
common thread that helps tie together the separate findings and describe 
the major impact EBCE has had on students, tn the evaluators' judgment, 
the central outcome of EBCE that has emerged during the last two years 
is that EBCE is a viable alternative for students who, for one reason or 
another, do not feel they are making the best use of their time ^t the 
high school. In particular, EBCE has been able to increase for many 
students their sense of personal worth and sel^-conf idence . 

I. 

Dr. William Glasser, author of Reality ^ erepy and a respected psychiatrist, 
has made two fundamental statements about this sense of personal worth.* 
He believes that true and realisti'c self-esteem is the basic element in 
the health of any hixman personality and that a person's self-image is a 
major determing factor of behavior. A similar statement has been made 
by another psychiatrist, Abraham Maslow, who wrote that "a chiM- cannot 
reach self-actualization until his needs for security, b^long^ngness , 
dignity, love, respect and esteem are all satisfied.** 

The (CE)2 staff has .stimulated growth *in these areas in a number of ways. 
They assisted students to understand and express their feelin^gs, interests, 
abilities :and vocational preferences. They provided, and encouraged, 
employer instructors to provide realistic feedback to students. They 
helped students plan, carry oiit an^ evaluate individual leari\ing 
experiences centered around their interests and abilities. Students^ were 
given an opportunist^ tp explore new areas, try out new behavior styles 
and occasionally experience failu^re in an environment where they could 
profit from mistakes without serious harm. 

An interesting question arises regarding the extent to which change in 
student self-esteem was a function of the EBCE program or merely a result 
of the personalities of the seven (CE)2 staff members. One of the mofst 



*" Glasser, William Reality Therapy , New York: Harper and Row, 
^Published 1965. 

** Maslow, Abraham H. The Farther Reaches of Human Nature , New York; 
The yiking Press, 1971, p, 190. . 
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frequent compliments heard from visitors to {CE)2 is the enthusiasm, 
warmth and empathy demonstrated by the (CE) 2 staff. In reality it is 
impossible to divorce the EBCE program from the (CE)2 staff since the 
program isr as much an alternative selected by the staff as it is ai 
alternative for students. Nevertheless, the strii^ture and organiisation 
of {CE)2 in itself appears to facilitate a growth Un self-estjfeem for the 
students who select this program to a larger degree thcin that provided 
by the regular high school program. In (GE)2 students and staff are not 
governed by the bell or, a regimen. Students are constantly required to 
make decisions regarding their own leacning experiences and "are held 
individually \accountable for following through on commitments. Other 
factors that allow the (CE) 2 staff to relate with students as individual 
persons are the lower student-teacher ratio and the differentia -ions of 
staff roles, (CE) 2 staff are not required to be subject matter specialist 
or to communicate a given set oL concepts to students. Instead, the staff 
function as learning facilitators and each staff member participates in 
student guidaijce relationshi^ps . In addition to the influence made on 
students by the (CE)2 staff, Students have also been reinforced and 
influenced b/ participating employers and community resource persons. 
This influence touches not only on career decisions but on other, areas 
of the students' lives as well. 

In addition to growth in self-esteem, (CE)2 students have also increased 
in their sel f-conf i<^ence , Student case studies conducted this year have 
provided many examples of this increase as demonstrated by^ students 
becoming more willing to explore new learning sites, feeling at ease in 
communicating with individual employers, overcoming shyness in talking 
to groups of adults, and becoming more willing to take responsibility 
for their own actions. 

Many, although not all, of the test scores have supported the increase 
in student self-confidence and self-esteem. The semantic differential 
scores involving students' ratings of the concepts of "adults" and 
"community resources" have shpwn statistical ly^ significant growth over 
the year, while the concepts of "me," "school" and "learning" have shown 
statistically significant growth over each of the last two years. 

This increase in self-understanding and self-esteem may be one of the 
most general izable outcomes of experiential learning such as that involved 
in EBCE, This l^arwing can help a young person to make career and life 
choices that are more satisfying, to become a more involved family member 
and citizen, and *i^o become open to sel f-£?ctuali:::ation as a human being. 

Although the case studies conducted this year demonstrate increases in 
student self-e,^teem, the studies were not developed with 'that outcome 
as 6 primary focus. It is suggested for next year that pilot sites 
intending to employ case study methodology consider using change in 
student self-esteem as a major focus for such reporting. This would 
involve the development of some indepth student interview questions and 
identification of behaviorally observable events that could indicate 
increase in self-esteam. 
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Evaluation Issues 

Because of the individualized, experiential nature of EBCE, students c?nter 
with diverse backgrounds ar^d interests, engaqp in many unique experiences 
and achieve many different oTitcomes as a result of participation. For 
this reason it har. not seemed appropriate to the evaluators to trv to 
impose tightly written behavioral objectives as might be appropriate, for 
example, in a traditional high school algebra ciass when all students are 
expected to accomplish the -same goals specified by the teacher within a 
fixed number of weeks. A possible exception to this approach has been in 
the verification of con^etencies and the learning managers' assessments of 
preprepared projects. In both cases, prespecified criteria have been 
employed although even in these cases individual student negotiation has 
been allowed. 

As a result of attempting to develop a philosophy of evaluation that is 
consistent with that qf the project, very few specific outcomes have been 
expecte<3 of all students. The evaluation instrument? and methodologies 
employed have related to the s^t^udent -outcome goals but not highly specific 
curriculum content. Thus, »roadly-gauged measures like the Comprehensive 
Test of Basic Skills , the Psychosocial Maturity Scale and the semantic 
differential have been used. Other instruments such as the student End 
'of Year Questionnaire have attempted to measure perceptions of processes 
such as the extent to which students felt they understood how to'go about 
entering a career of their choice. The use of case study methodologies 
involving observations of students at various times throughout the year at 
employer sites; personal interviews wt^th the students, their employer 
instructors and parents; interviews with {CE)2 staff ^nd analysis of ^records: 
analysis of numerous student monitoring documents; and independent ratings 
by an outside reviewer of student projects and products—all were essential 
tools in providing a description a<ld evaluation of how individual students 
interacted with (CE)2 and what they gained from their participation in 
the program* 

The findings resulting from the case study approach and from the -'group 
testing were usually consistent. In some areas which were diffic It to 
measure or observe in a reliable way, such as student trust of others, 
theire were insufficient, results to make str-ong conclusions.- InV^eneral/ 
the written tests facilitated a comparison between the {CE)'2 students 
and^the control group students since they were easily translated into 
quantitative units. The case studies, however, were much more useful 
. in providing the qualitative information needed in describing the (CE)^ 
protesses and outcomes as, they varied from one student to another. Both 
approaches--together with the use of monitoring data available on all 
students; ^ survey data from students, p<jrents,- employers and staff; and 
follow-up data on {CE)^ graduates— were needed to provide an integrated, 
aomprehensive evaluation. ^ Unfortunately,* the data and analyses from 
paifent and- employer surVeys and the follow-up interviews of former (CE)2 
students conducted b/^gducational Testing Service (^TS) , the external evaluation 
contractor, were not received in time to be used in this report but will be ^ 
available by December 1975. The evaluators therefore recommend that time 
be set aside in December by the EBCE key st^iff and interested outsid<3 
^?^/i^f "View the ETS-evaluation report, thd anthropological report 
Of {CE)2 prepared by Edward Durgin and this evaluation report by the 
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NWREL EBCE eValuators. At that time, the major outcomes of these reeorts 
could be discussed in li^ht of the Cpleman report* and other such documents 
describing the transition of" youth to adulthood. The results of such an 
evaluation conference should be written into a nontechnical' article fo^r, 
use by potential adoptors of EBCE. 

The. vise of an experimental desiqn, involving the random assignment of . ' 
applicants for {CE) 2 into program participants and into a control group 
which remained in fehe* regular high schot)! program for the- year, was a 
time consuming and complex process. Chapter III of this report describes 

, the problems' of the differential attrition between the two groups. Despite' 
an excellent job of student recruiting by the (CE)2 staff, the use of 
financial rewards to encourage parti tipation by the coi^trol group in the 
testing, and the intensive efforts b^ the NWREL evaluators and ETS 
representative to locate students, complete pre- and posttest data were- 

''collected on only 12 control group students. Although the cost of 
using* a control group was high and the number for whom data were obtaihed . 
was small, the evaluators feel that the benefit gained from employing/ an 
experimental design during 1974775 outweighed the costs. Without the - , 
control group it would have been impossible to determine what student 
outgomes coul'd be 'attributed to participation in (CE)2 aa compaj;pd with 
alternative- explanations . The .evaluators , however, do not recommend the 

.use of cpntrol groups \n future EpCE' sites during --the first year of 
' Program development.** ^^or is the use of a control group recommended in 
the future for the (CE)2 site in Tigard, Oregon, since^the majority of 
evaluation questions for that site have been adequately answered this 
year.. ' ^ ^ / - 

Based- on the evaluators' experieiacQs, a number of specific changes are 
recommended in evaluation* instruments and procedures that were used this 
year in (CE)2. These recommendations, together with a rationale for each, 
will be incorporated in ^ the EBCE Evaluation Package to be developed in 
FY 76 by the NWPEL ;EBCE evaluation unit. 

Future Research Needs. - . ' \ , / 

The EBCE research and.evaluation staff at NWREL over the past, three years 
has identified a number of research issues that need further investigation. 
In assessing the priorities pf each issue, the evaluators have selected 
three as most critical at this tj,m^'. These three issues deal with: 



* Coleman, James S., et al. Yout;h; ' Transition to Adulthood, Report o f 
t he Panel on Youth of the President's Science Advisory Cotnmittee . 
Chicago: University* of Chicago Press, 1973, 

** The evaluators would,' however, recommend that stifdent case studjies be 
considered an essential part of comprehensive evaluatio|j^j3^ fo^ts .of 
individualized programs such as EBCE;. Without student case^ studies * ^ 
the evaluator would have great difficulty in attributing .significant . 
differences in favor of as experimental group to specific treatments 
4n a program and would also lack information regarding diversity and 
variation of treatments among* prpgfam participants. • ' ' - 
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(a) a study of he strategies used to successfully implement a large scale 
program sLch as^EBCE in local school districts, (b) developing techniques 
to assessi career decision-making strategies of students, and (c) a study 
of studenH^' changing personal and work values influenced by experiential 
learning arvcommunity and employer sites. Each of- these topics addresses 
real world issues and would have payoffs for educational practitioners 
and researchers alike, 

1, Reseape^n conduct^'ed on strategies for successfullv implementing a 
v.^^lap^ scale prograr such as EBCE could address questions such as: 

a. What impact does the use of federal funds have on the planning 
and implementation of innovations such as EBCE? 

b. What factors are most influential in leading a school district 
^ to^favor the adoption of one particular model of an innovation 

over other modeX^? 

c* What are the factors perceived by administrators, teachers, 
students, parr^nts and employers as facilitating or hindering 
the implementation of EBCE? 

c 

d. What roles' do state educational ■ agencies and educational 
laboratories play in the implementation of EBCE? 

With the anticipated heavy investment of funds from Part of the 
Vocational Education Act into the national implementation bf EBCE it 
becomes increasingly important to answer these types of questions. 

2: Many systems and techniques currently exist which attempt to match 
occupational career areas with personal preferences, competencies 
and attitudes. However, most of these techniques are system 

• dependent. Little emphasis is placed on encouraging the respondent 
to seek out information about occupations, weigh this information 
based on personal characteristics and then formulate a personal 
career decision. Instead, information areas and precedential 
selections are forced or the ie:^pondent and the final occupational 
selections are forced by the system. Removed from the system, the 
respondent may be unable to "choose" those occupations for which he 
is best suited. 

* An approach which would maximize careW decision making would be one 
where the respondent is ^qrc^ to ask the questions, weigh the 
in^-^rmation obtained and make the final career decisions independently. 
Such a strategy would be valid in assessing career decision making 
gains attributed to programs like EBCE, The decision-making 
strategy would be examined to estimate facility for asking the 
most importc*nt questions which maximally impact the final career 
derision. In additio^n, one could examine the fidelity of personal 
preferences, compecencier and attitudes . with those exhibited by 
characteristic members o^ the chosen oc^Xapation, 
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Some of the questions which could be answered by this research 
include: 

/ 

a. What career decision-making strategies do EBCE students bring 
with them to tha program? 

b. What are the types of patterns of career decision making? 

c. Which characteristics of' persons and occupations maximally 
di:f criminate i.. career decision making? 

i. Wliat changes in career decision-making strategies occur as a 

resvilt of participation in the EBCE program? j 

I 

e. What components of the EBCE program have the maxiynum ^ef feet on 
changes in career decision -making strategies? 

. ' ■ ' I 

f. What Ts the permanence of J earned decision-making strategies? 

q. Wliat alternative techniques ( can be utilized to ^tnalyz^ career 
decision-making strategies? | , , , , - 



3. 



Data collected this year from th^ Psychosocial Maturity Scale 
indicate that (CE)2 students have made a number of /shifts in their 
personal and vocational attitude^. Some of these riewer attitudes 
apparently involve a less idealistic cpncept of work obtained froF 
experiences at various employer and community sites. The effects 
of changes in student attitude influenced by participation in EBCE 
may be more important than specific skills gained by students while 
in the program. Research is neecjed to answer questions such as the 
following: ^ 



a. Is there a set of personal and vocational values that are 
commonly shared by EBCE students, staff and employers 
participating in che program? ^ 

b. Are the values of students •and employers selecting not to 
participate in EBCE significantly different fton\ those who 
choose to participate? \ 

\ 

c. Do student^' values become more aligned with staff and 
participating employers' values as a result of participating 
in EBCE for one or rtnore years? \ 

' ' \ 

d. ' Can the values of a new student, staff or participatiing 

employer be used to predict that individuals' degree\of 
acceptance and participation i|n EBCE? \ 
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